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IDENTIFIERS 
ABSTRACT 

California's review process has been designed to 
judge the jaff acts of the school program on -students and staff and to 
identify Opportunities for improving the program. Program reviews, 
which may be conducted by the state Department of Education, county 
.or district personnel, or school staff, * are developed primarily from 
observation .of individual studknts , analyses of the ftudents' current 
work, .instructional staff and student explanations of students' 
current and past activities, *nd instructional and management 
material used by the staff. A pxo6**ir*r r eview is organized into three 
secions, involvingvthe effect, of in/tpUct ionxon students, the effect 
of support on instruction, and 'the 'tf f-ect of the improvement process 
^on support and instruction. Eabh section cdntftins the criteria for 
.judging quality, a guide for collecting information, and work sbeets 
for preparing suggestions on program i improvement. Each quality 
criterion is measured on a seven-point scale from .high effectiveness 
to low effectiveness. This sdale is based on three paragraph* 
describing schopl programs with high, middle, or low effectiveness. 
The reviewer decides which description best fits each aspect of the 
program. The guide for collecting information about each criterion 
identifies areas of investigation, tprimary sources ff information, 
and methods' of verifying information. ( Author /MLF ) 
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CHAPTER I 



THE PROGRAM REVIEW 



A. DEFINING A PROGRAM REVIEW ' 

The Purpose of Program Review 

Program review Is a process used to evaluate the 
quality of a ^school program an<J to Identify, ways in 
which the progfam can be Improved. Pro gran review say 
be Conducted by State 'Department of Education, county or 
^district personnel who, although external to the school, 
-share accountability with the personnel at the school* 
for the qtpllty of the instruction provided for 
students. The review process may be used by the school 
staff. * ... 

The prlaary purpose, of prograa review, whether an 
external or Internal review, Is to improve the school 
program. It Is a means for developing and Sustaining a * 
high quality educational program for each student. 



The Scope of 




Review 



/ The program review process described in this hand- 
book is based on a particular perspective toward . the 

V school prog r a*. This perspective places the focus on 
students and examinee the effect the instruction 
received by the student actually has upon the student, 
the effect the support for the instructional 'program has 
upon instruction and the student, and the effect the 
program improvement process has upon both instructional 
support v and instruction* The relationship among these 
aspects of the school program is shown - in Plgure 1 • 
Not ice . that the student, pis at t-fae center and is the 
Intended recipient f directly or indirectly, of the 
effect of the other aspects of (he school program which 

-are,. depicted aa concentric rings around the student.' 
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Instruction 

For review purposes, instruct ion'As defined in two, 
ways. First, it is that instruction actually received 
by the student in contrast to the Instruction offered by 
the school or, in other words, the instruction actually 
experienced by^ the * student versus instruction launched 
toward hla or her by the, staff, Secondly, instruction 
is broadly applied and Includes all the learning 
experiences of students during the school day aa well as 
during extracurricular actlvltlfs under the control of ' 
the school. v 

Support 



*The next ring includes two kinds of activities: 
ThoseAfcanned as support to Instruction, such as staff 
development and parpnt involvement, and those services 
that dltectly support students, such aa -guidance and 
health services, 
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The Improvement Process 

• ■ 

The outermost ring of activities, the Improvement 
process, Includes- the council /committees which have 
responsibilities for planning the program and all of the 
Informal as well as formal processes used In developing 
the planned program. These Include both yearly and 
ongoing planning and evalYutlon ^activities as well as 
activities which * translate the planned program Into 

action. ^ 

* 

The Review Strategy 

J 

The review strategy is based on the perspective 
toward the school program just described. The review 
starts with the student and works out toward Instruc- 
tion, support, and how the planned program is being 
translated into action. fhis direction— from* the 
student outward— Is complemented by a review of the 
planned program which looks at how The plan was or' was 
not translated into action and if the .effect of plan- 
ning, translation, evaluation, and support activities on 
instruction. Thus, the review team wilT "go back and 
forth through the rings or layers of the school program 
to determine the effect of one part *f. the program on 
another and analyzing J»w the effects might be 'improved 
or maintained, pursuing key linkages where activities 
jhave been particularly effective or where improvements 
might have particularly % high payoffs/ The rinks 
emphasized are: f 

' e The link between the instruction received by the 
student and what adults do to make this instruc- 
tion happen for the student and 

e The links between the planned program and trans- 
lation activities and between the translation * 
activities and the Implemented program 

00 - • 

S . 



The strategy used by the reviewers is to develop a 
picture of 'how things work for the students at* the 
school. This picture is, developed- primarily from 
observation of Individual students, analysis of the 
student's current work tconpecting the current work to 
past work), Instructional staff and student explanations 
of student's fur rent and past activities, and instruc- 
tional and management* material us 4) by the staff. These 
observations are supplemented by discussions with staff 
and parents. This picture forms the' basis for the 
rayiewers 1 judgment of the effect of instruction on the 
student. * 

After the reviewers "have a picture of* what is 
happening ' for the students, they focus on finding out 
what processes at the school contributed to what is 
happening. The reviewers seek explanations fro* staff 
of why they do things , ? the way- JL hey do, where the 
'instructional program comes from," how it Is Supported 
and improved, how pj.ans get translated Into action, and 
so "on. The focus on effects rather than on prt>cess 
for processes' sake. This picture forms § the bMll* for 
the. reviewers* suggestions regarding oppprtunlties, for 
improving the effect of instruction on students. * 

As the reviewer completes the rev£ew of /the pro- 
gram, a report of . findings is jfrepared (see Chapter 
III). The report, which Is based on the perspective 
toward a fchool program described earlier, provides for 
two types of findings: (1) the judgment of quality of 
thrf' effect of each aspect of the ."program dnder review; 
and (2) suggested opportunities for improving or 
sustaining the effectiveness of the program. 
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By using these opportunities for improving, the reviewer 
* identifies- prime improvement' aretos and indicates how the 
improvement process at the school can be ^activated, to 
Improve or sustain the quality of the program ln< the 
areas Identified. 7 

The Relationship -.Bet ween Program Review , 
^ and Ongoing Planning arid Evaluation 

The program review process described In this hand- v 
book is designed to complement, not replace, the exist- 
ing ongoing planning and evaluation processes at a 
school. Reviewers should ^6ake extensive us* of infor- 
mation developed within* Che H school's ongoing planning 
and evalua^on procedures. Together , program review and 
planning . and evaluation procedures can form a -major part 
of the total evaluation process ^t a school. 

. Reviews conducted by reviewers from .putside the 
school provide a fresh viewpoint 1 and Independent vali- 
dation of Internal review findings. The program review 
conducted for the State Department of Education, -either 
/ by a state review team or through a consortium of dis- 
tricts, will be bas^d *on this handbook. In contrast t&. 
the two or three days available for external reviews, a 
school| can use all or part of thjse ^tocedures over a 

^ longer period of time. Such use of these procedures by 
the people at a school prior to an external review cdn 
do much to Improve the validity of, the external revlef. 

1 Familiarity with the review criteria *nd procedures 
will help Staff and parent m communicate effectively with 
reviewers f and they w/ii help reviewers obtain the 
Information they need tff make Informed judgments. 

JPhe findings of program review/ whether Internal or 
external/, can be of assistance in discussions and 
decision making about designing and implementing staff 
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development ac^i pities, in determining where assistance 
is needed, and In determining . where changes {re needed' 
in the way the planned program Is translated * irtto t 
action. In short, the program review process yields 
information that is essential to effective program 
development — Information about what Is working, well an<j 
why and whdt should be changed and how. Program review 
can be a valuable part In jthe prqgram Improvement cycle 
of planning, translating the planned program Into 
action, evaluating the Implemented program, and 
modifying the planned program. % . 



Program Review Responsibilities 

• m 

For the purpose of program review, to' be achieved, 
reviewers and school personnel alike must' recognise and 
accept their responsibilities for ensuring that, the 
review process is a fieans for developing and sustaining 
a high quality educational program for -each student at 
the school < . 

Major Responsibilities of the Reviewers 

The majt>r responsibilities of th^ reviewers are: 

if* V * 

• To conduct the review thoroughly enough for the 
development of a clear and accurate understanding 
of the effectiveness of the school program. 

• To use that knowledge to make usable suggestions 
for increasing or sustaining the effectiveness 
of the program. 

In fulfilling these responsibilities, each reviewer 
must: 1 

#. Prior to entering into the review process, put 
aside any preconceptions of what the program, 

/ 
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• • should be> like at well as any .personal , ^educa- 
tional, or managerial preferences. 

- . * f * • / 

• .Use the selfrreview findings to facilitate 

. discussions with school staff and, parents., 
These discussions should cover the school pto- 
* gran and how well itjrts working and provide * 
» . evidence suf ficient , to' verify, extend, clarify, 
enrich, or repudiate those findings. 

•Be able to reflect back to th^ school--as a . 
mirror— the .picture he *oc she has developed 
of the effectiveness of the. school program. 

a Be able tp llnk the knowledge of what the pro-.' 
% gram is With What the scbbdl community' intends 

. it t^o be in such* a way. that the school 
jf ' " eommwlty can use the program .review experience 
as a springboard for concerted improvement 
adtiyltlel. % 

p Recognize and support the program improvement % 
• . "efforts of the school community. 

Major Responsibilities of the School Community 

y , % * 

.The major responsibilities of the staff, parents 
v ancL community members involved in a pftgram review are: 

• To know the planned program and how k well it I's 
^working for the* studeidfc • This requires knojr 

* 4 ledge of the planned program as a whole. 

•* \ ■ ) • 

^ To know what he or she is doing in relation tp 

the planned program. n 

• • To be t$ady to share this knowledge with the * 
review team and to be able to direct reviewers 
to the information they need to fulfill th^ir, 
*►'• responsibilities. 
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• To be familiar with the program review process 
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and qrlterla described in this handbook. _ 

• v •# 
f Tb be involved as a total staff In .Identify- " • 
^ing program strengths qnd Weaknesses fflPrelatlon 
to program review "Opportunities for Improving" 
0 and the corresponding criteria. .This requires 
spiling out activities which are working well 
as w^ll as areas where improvements- are needed. 

* • • To be, able ta describe to the review team how 
- the schodl!& self review results fit id to the 
— ongoing /planning and evaluation process. 

In es^enbe, the role of f^hnnl persennel is one 
that is created through shared understanding o^fhe 
revleV process- And how that process ,interf a<*es ^ith 
implementation of their planned program. 

How the * School Qomm unity Prepares /for a Program ' Review 

Whitejtoe review team is responsible for learning 
as much ab'Qu^Phe program as can be learned in a limited 
period of tirn^, the school community is responsible for 
making sure that the" team is given accurate and, complete 
information about the programs Therefore, a school 
community prepares for -program * review — whether Internal 
o^ external-through ongoing planning and evaluation 
activities tHatc enable the members . to know how well 
thefir program's working and why. • 

Slqce exteflKl review teams wilW.be using th^e 
^kandbook, schools to be reviewitf should be) familiar, with 
ti^se procedures and adapt them ^a-^fevaluating the 
current effectiveness of the}/ program. The procedures 
can be applied \$i h * |P 

• • ' ■ i " ' \ . . 

e E£ch teacher judging the effect of his or her. t 

^ . ins t rut t >rfna 1 pr og rem, using tfie program 're v4#w 
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criteria* and identifying opportunities fpr 
improvement* 

" ' «" 
e Ekch classroom teacher trading classrooms irith 
another teacher to observe "how** and "what/, 

* .students are learning and Judging the effect of 
j Instruction on students. 

• Teachers at each grade level or grade span selecting 
a teacher or a few* teachers to apply the Instruc- 
tion and Instructional support criteria In each 
claastoom. 

• • The/School Site Council, School Advisory Council, 
& . Bilingual Advisory Committee selecting members to 
. form a review team to review the total program, 
using the criteria for judging the effectiveness 
of instruction, support, and the Improvement 
process* . 

The findings of the self-reviews should not be 
fbcftised on the "rating",, but on how the program Is 
affecting students*. That Is, what has been learned 
- during the review* However, If the ratings are to be 
known by the ayff anil others at the school so that they 
can be shared With a review .team and used for making 
decisions about program Improvement activities and 

• confirmation of* program ef fectlveness, what was learned 
about thje program through the review process 'must be 

') communicated to the entire schoojl community. 

While the review process described In this handbook 
, c overs the total planned program at the school, school 
| personnel planning for program improvement may find It 
beneficial to review part of their prog r aim at a time, 
covering^ the entire program over a period of months 
rather than trying to review"" the entire, program at one 
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B. THE PROCESS OF PROGRAM REVIEW 

^ 

Preparing for the Program Review 

This sect ion desc rlbes how a program review Is 
conducted. While the descriptions and' instructions are 
directed primarily toward reviewers who are external to 
the sc'hodft, the school should ^adapt, as appropriate, 
parts of this process for use in self-review of the 
quality of the school program. 

Reding the School Plan ^ 

The school plan Is the flr%t contact the reviewer has 
with the program at the school* Prior to the school' 
visit, the reviewer will read the school plan 
thoroughly, _ probably several times, , to ensure 
understanding of the planned program* 

After reading the plan, the reviewer .sho&d know: 

<• The special funding received by^he school and 
1 "related program requirements 

e The nature of the student population 

t _ 

e The program areas that will be reviewed 

e The goals of the program aod t expectations for 
student and adult performance .( objectives) 

e What should bj observable (activities) 

• Relationship among needs, oitectlves, and. 
activities ' ™ 

* 

e Processes defined In the school plan (planning and 
0 evaluation activities, monitoring of program imple- 



mentation, articulation/ and/ or coordination activities 
designed to bring together ttie various services - 
provided ffor students) 

e Invertffcatioo strategies Which the reviewer will 
'use to find or validate those processes which are not 
clearly defined + 

The reviewer aust have a good grasp of the planned 
program as represented in the school plan in order to 
understand, the prograa provided for students at the 
school end how the people at the school plan to sake the 
prograa, work. 

Contacting the School 

Approximately four weeks h/fores the school visit, 
the. review teaa leader will telephone the principal. to: 

e Discuss the self-review process used by the school in 
preparing for the review 

• Discuss the review procedures to be used by the 
/ reviewers, and establish the review schedule 

e Clarify any questions about the prograa steaming froa 
the review of the school plan^ 

e identify *any aajor changes Jn the plan or budget 

# e Identify areas of the sqhool prograa to be covered in 
t^m review' 

e Identify the docuaents that the teaa will need to 

review . ' ' ~ " * 

e Clerify any concerns or questions that school principal 
and staff aay have 
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e Discuss the nature ofr the school coaaunity 

J. 

s Identify all special services currently Offered at 
school site 

^ j, 
e Discuss how the randoa sample of students representa- 
tive of the prograa areas to be reviewed will be 
.chosen. The school usually has soae fora of numbering 
system for the attendance register. Agree oh a 
procedure for the principal to use and agree that 
procedure will be verified oh the first day of the 
review. 

Preliminary Meetings 

On the eyening prior to the actual review, the 
review team will meet with a representative team froa 
the school. The school team's composition is the 
principal/s decision. The lead reviewer should suggest; 
that the principal aay like ' to invite SSC/SAC/BAC 
chairperson and program manager. Other school or 
cowunity personnel may be invited at the discretion of 
the principal . 

The meeting will be used to: 

s Introduce teaa aeabets 

is Discuss the purpose of the tevieV 

s Review the procedure*, e.g. , daily interviews with 
students, followii^ the saapled students* prograas, 
observations in the classrooms of prograa iaproveaent 
areas, talkii^ to students, discussing their work, 
talking to aidjef^abGwt .their 'r^les, "talking L t o 
curriculua leaders such as department heads, talking 
to* district personnel and other adults involved in the 
instructional procesli 




p Coordinate throe-day schedule / 

o Learn abou^ the school/ community setting frop/the staff 

o Review any self-review Information provided by sb^jool 
staff % 

o Review contents of the school pjan and update supplied 
by t^e schol staff i 

o Discuss other areas of concern as they are Identified 

" Following the meeting with school personnel , the 
rfcviev teas will have an organized meeting. The purpose 
of this saetlng Is to: 

o Assign responsibilities for specific program areas 
being reviewed " 

e Formulate quest ions to be answered during the review 
process 

e Outline review strategies * 

e Develop a cosaon understanding of teas processed ' 

e Identify possible problem areas 

o Begin to develop teas rapport * 

* 

a Discuss the school, plan 

a Plan strategies for the review 

a Define fevlewer roles am* responsibilities 

a Designate seating times during the review to "touch 
base" and share perceptions 



a Review the- schedule 



e Get j^kn 



ow each other's Interests fend strengths 



Conducting the Review 
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In finding out abojit the quality of the school pro- 
gram, three basic review procedures are used Vl). class* 
room observation; \ (2) interviews — both foraal >rtd 
informal , and (3) the review of records and documents; 
Each of these methods Is used in conjunction > with the 
others* For example, 'While observing in f classroom the 
reviewer will learn what currently Is happening. By 
look! 1^5 at a student's work of a few days ago and 
records of students' progress over a few months, the 
reviewer then develops a sense of how appropriate .anil 
how typical the observed activities are. Similarly, by- 
talking with the teacher and students about the observed 
activities, the reviewer can verify the accuracy and 
completeness of his or her observations. Information 
gathered through each method Is verttjled by information 
from one or both ot the other ^procedures. 

Observation, of . Instruction 

* ' / 

Through observation of instruction, whenever it 

takes place, the reviewer gathers baajc information 

about the school prograa, in order to Judge the effect of 

the instructional prograa on how and what students are' 

learning, the affect of staff development activities on 

those working with the -students , the effect of other 

instructional support activities, the effect of 

activities to translate the planned program into action 

and so forth. 

t 

.NOTE: Observation of instruction Includes rtformal 
interviews with students and stiff, based upon what has. 
be^n observed; as well aa the observation of activities. 
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Interview*, *' . % 

. ' } t * > 11 

The basic information gained through ciassrooto, 

observation is verified, clarified, and expanded. through 

interviews. Interviews enable the reviewers to leafn how 

the progrw came to be the way it lr, as wen as to 

better understand the program as it is and.mighfe J>e.. 

In the threerday review process, interviews are an 
extremely important source of information about the 
program and how staff, students, and .parents relate to 
the* program. ^Gr^ interviews with teachers', aides, stu- 
dents, councUs/co«»ittees,\disrfict personnel', suppprt \ 
btmff, and volunteers serve several major purposes. They 
enable reviewers to: S 



• Verify data obtained from other sources 

*• Collect data that have not been gathered A froa ather 
sources 

• Resolve conflicts in data collected 

. f 

• Give people the opportunity to share pap t experiences, 
present realities, of future plans which the reviewers 
might not have uncovered 

• Offer an opportunity for peopl^ to ask questions of 
the team 

• * , » 

• *Glve the team fn opportunity to inform the group of 
areas still needing clarification 



Review of Records and Documentation. 

Information gathered- through classroom observations 
of instruction and interviews is- verified, Ixpande^, and 
clarified through the review of such record* as: 

s Lists of students to receive special service*; such 
as LEP, Title I/SCE\,<and students witj) exceptional 

N needs * 

*■ * t 

s Records of student progress /including IEPa,«lLPs, ^ * 
and other Individualized learning plans 

s S^dent test results, including California Assessment 
Program (cXp) data, over a period of years 

I ' . . 

s Minutes of SS£/SAC/BAC meetings 

# 

s Evaluations ot staff development and parent 
education activities 

^ s Newsletters and other communications to parents 

s Program evaluation information, including self- 
review findings 7 > 

Reviewers are. cautioned to remember that only those 
^records that promote program implementation and improve- 
ment and thoie that are necessary ttf "document compliance 
with laws and regulations should be maintained by the 
school. Therefore, do not overemphasise the importance 
of records and documents. 
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How these three review 1 procedures: observations of 
instruction, interviews, * and review of records and 
4ocuments are used In the evaluation of the program is 
described In Chapter II, 

The events that "occur during a frrograp review . 

The event* which are a standard part of a review aret 

e An. informal introductory meeting with the staff (if 
9 posssible) 

e An initial meeting with the principal 

e Obervation of instruction, including observations of 

Individual students r 

• » 

e Individual Interviews with staff and students 

• Group Interviews - for staff by department or subject 
artfa, as well as with committees, including student 
organisations 

e Ongoing discussions with th<T principal about the 
progress of the review * 

• Compliance review with the princiji^l 

e Ongoing meetings of reviewers during the review days 
and evenings V- 

«m Preparation of the final report 
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e Two-stage report: 

- To £he principal * 

- To the total school community 

Introductory Meeting with the School Staff 

If possible, arrangements should be made for a short 
Informal meeting of the school staff and the reviewers 
prlor^to the beginning of classes on the first morning 
of review. During this meeting the reviewers wlllf 

e Describe the purpose of the review: 

t - To judge the quality of the school^ program, using 
J the Program Review Handbook < " 

- To make recommendations regarding program 
Improvement * 

- To recognize program strengths " 

• * * 

-/To assess program compliance, using the Guide for 

Reveiwlng School Program Compliance 
- ^ f , 

e Describe the procedures that will be followed: 

-=* f 

* 

- Observation in eacfc instructional setting Included 
in the planned program and special education 
progri 



- Interviews with, and following of, individual 
students * { 

- Grpup Interviews with, teachers , students, aides, 
support staff, councils/connit t^es , parent 
volunteers', district office •staff - 
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Initial" Interview with the Principal Vj 

During this interview the reviewers will seek Infor- 
mation to help them get started on the review. This 
Information nay Include: 

• Historical perspective of the school, e.g. changes 
-In program arid or .Implementation processes , period of 
special funding, changes In student population, \^ 
changes In te archer staff, and so forth 

• Self-review process and results 

• Final schedule for review 

• Location of documents to be stalled 

4 Personnel employed — name, funding, role,* and 
responsibility 

• Map, of school and schedule of classes, labs, and so 
forth . m 

• Any special programs not Indicated l.n school .plan 

• Any other Information the principal wishes to 
communicate to the reviewers 

Individual Student Interviews , 

Each member will Interview several Individual 
students before observation of Instruction begins. These 
students should be 'selected randomly from among students 
representative of the program areas to be, reviewed. The 
information obtained from these Interviews will help 
formulate an Image of each student *s day, which fcan be 
clarified and validated through * direct observation In 



Instructional settings, discussions wlht members of the 
school staf fjpand further discussions with the student. 

Observation of Instruction 

At least one reviewer visits each Instructional 
setting that falls within the scope of the review. 
Ins t ruct lonal set 1 1 ngs Include c las srooms , shops , 
resource specialist rooms , e libraries, gymrf, ' theaters, 
and media centers. & necessary, return visitations. are 
made to verify informatlQn and establish -a flifr 
understanding of .the School program. 

* During each visit to the Instructional setting* the 
Reviewer focuses on what/students are doing, talking to 
students, looking *t < £Hfelr work, and reviewing records 
of their progress. The reviewer also, talks to the 
teacher, and other* adults such as aides, who may be 
working with* the students, to clarify his or her 
understanding of how and what the students are learning. 

Group Interviews 

Group interviews are scheduled for 30 to 45, 
minutes. Because the teacher interview is a key to 
. understand!^ the total instructional program, 8taff 
development °and translating activities, an hour or more 
should be allowed for this interview. 

^Separate interviews should be held for teachers 
involved in each of the different instructional areas 
included in the plan and being reviewed. Pot, example, 
all teachers involved in - improving the math 'program 
should meet together with members of the team, all 
teachers involved In implementing reading in the content 
areas should meet together with members of the team In a 
separate meeting, and so forth. 
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The people who should be Included in each group 
Interview are: ' * ^% 

• ■ • : x 

• Ttacher interview: 
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- All regular classroom teachers Involved with the 
planned program, as described above 

- Special education teachersAspecl&llsts 

e Aide Interview: 

**** * * 

- All* instructional aides (classroom, resource/media 
center, E$L, and so forth) * 

,1 * 

- Special education aides , ^jf ' 
e School support 0 staff Interview: ' ' 

- Other non<Jlassroom certificated personnel assigned 
full-time to* the school (Resource teacher, library/ 
media specialist , 'program coordinator, resource 

* specialist, and so forth) * 7 * > 

- Monclassrooai certificated personnel assigned 
directly to the school on a* part-time basis 
(psychologist, nurse, language specialist, and the 
like) 



* Any classified persdflfel whose duties might be 
considered support ratherythan instructional . 
# (home/school liaison, parfnt volunteer, 
coordinator, health* aide) 
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District support staff interview: 

District-level personnel who are not paid 
through special program funding and who are 
responsible for the programs' at the school 
(curriculum, guidance) f 

District-level and SESR personnel who are jJaid 
through special program funding and who are m * 
directly responsible to the school (program 
specialists, evaluatorsj an<j^#ie like) 

Parent and other nonpald voluteer aide interview : 

NOTE: SSC/SAC/BAC members should not be Included i 
this category. ^ ft 

Those persons who volunteer their time in 
classrooms. , 

Those persons who volunteer their time In support 
activities (making materials, translating, 
telephoning, and so forth) 

SSC/SAC/BA^ Int ervlew: . 

All members (principal, teachers, other staff 



members as. well as parents and community 
members) of the councils/committees Mould be 
Included. Logistics may determine that, In a 
scl^&l with more than one council/committee, only 
one of the grou£ may be Intervlewed'at a given 
time* In thla case, be sure *hat%ach group is m* 
interviewed. / *^ 




Ongoing Discission wit IT the Principal 




Duping the review, several tines should be. set aside 
for informal and/or formal discussions with the school 
principal. These meetings serve to keep the principal 
abreast of: ^ ^ 

• How the review is proceeding 

• Areas in which information is incomplete - or missing 

• Areas in which compliance Issues may be arising or in 
which information 1* incomplete or missing 

• Scheduling difficulties t 

• Other information which should be communicated during 
the interview 

In addition, the meetings provide an opportunity for 
the principal to give feedback to the reviewers about how 
the review is being perceiv&i by the school community as 
well *s to provide needed information to the reviewers. 

Ongoing Reviewer Meetings 

Throughout the review, the reviewers im*st meet 
frequently to ensure consistency in their perceptions of 
the program and the process of review, as well as their 
concepts of areas for improvement. The several times 
that have been found to be most productive, for meetings 
"of .reviewers are: * 

, # Immediately, before of after lunch (lunch Itself is a 
good time to talk informally with staff or students) 

• Preceding group interviews — to determine questions to 
be explored and issues to be raised ' 



• At the end of each day of the -review—to t*gin to 

' determine quality ratings, compliance findings, and 
opportunities for improvement for those aspects of 
the program needin^no further clarification and to 
design strategies for collecting additional infor- 
mation anM/or resolving conflicts in, information 

• Preceding the preliminary report to the principal 
at which time all compliance findings, quality 
ratings, and suggested opportunities for improving 
are finalized and the ruffes determined for the last 

two reports 

- • . J 

- Preliminary Report to the Principal 

Prior to tfce final ref>ort to the school, the 
reviewers meet with the school principal (and anyone 
else of his or her choosing) and share their findings of 
program quality, * their suggestions for program 
improvement, and program, compliance findings that will 
be. presented in the final report to the • school^ 
community. If the ongoing, discussions between *fce?' 
reviewers and the principal,* have -v-been complete 
and communication* have been open, this preliminary 
* report should be largely a confirmation of 'the previous 
discussions. 

The Final Report , to .the School , * 

The final .report includes the review team's find- 
ings of ,the quality of the school program/ its Sugges- 
tions for program improvement f and the compliance 
findings. It is a report to the eatire school commu- 
nity. For a description fo the final report, see 
Chapter III. 

. 12 • • • 2 y 
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How the Findings of the Program Review ire Used by the 

School ~ " ~ % 

Since the primary purpose of program review, whether 
Internal or external, Is to find out how well a program 
is working fo the benefit of the students' and others 
being served by that program, the findings of program 
review should be * so stated that they can be used .in 
planning activities that will sake the program more 
effective, that is, planning wh*t activities to' continue 
and which to replace or modify. 



Following the program review the SSC/SAC/BAC, 
along with other staff and parents, should review the 
selected opportunities for improving to determine their 
potential effectiveness for. the school 4 prograi and tfi^n 
decide bow, to incorporate t^em into the progra*. It Is 
important for staff and parents- to realize that . the 
selected opportunities for improving are not mandates; 
they are the reviewers' best suggestions for* how the 
school program might be ma^e more effective for the 
stud*fo*, the staff, and others of the sct»ol. 
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CHAPTER II 
CONDUCTING THE PROGRAM REVIEW 



/ 



Thfe chapter describee how to, conduct a program' 
review. ft is organized into three sections : The 
Effect of Instruction on Students; The Effect of Support* 
on Instruction; and the Effect of the Improvement 
Process on Support and Instruction. Each* of * these 

^■•ctione contains: SD .the* criteria for Judging 
quality, (2) a guide for collett£f« information, and (3)' 

'Opportunities for Improving worksheets, which are used 
to pre pave suggestions for program ^improvement . 

* • 
A. USING THE QUALITY CRITERIA 

The Criteria for Judging Quality 

' f 

The qualify criteria are Intended to describe the 
effect of activities on~the client (e.g./ the effect on 
the students of Instructlonat^actlvltles and the effecf 
on instruction of support^ activity) . Each criterion 
is referenced to a seven-point scale from high 
effectiveness to low effectiveness. This scale is 
anchored by Jthree paragraphs irtiich describe what a 
school program looks Hke from the perspectives of high, 
middle, and low effectiveness. The reviewer's job is 
to decide which description best fits the aspct of t;he 
program being reviewed. The intermediate points on the 
«cale are for use when an aspect of the . program is 
judged a hit more or less effective than these anchor 
descriptions. These scales^ are designed far use with 
the review procediiree described in the handbook and with 
the guide for collecting information tha£ follows each 
quality criterion. , ? 



The quality criteria for each section both describe what 
the reviewers are seeking to learn about- a program and 
provide a framewock for makii^ judgments about the 
effectiveness of H each aspect of the program and how that 
effectiveness might be enhance*} or sustained. In using these 
> crlterla f reviewers must 4 observe the effects of instruction 
on students am) decide which descriptive paragraphs in "How 
Students Are Learning" , best describes what hat been 
observed. They must also gain sufficient understanding of' 
what the instructional program Is, how it came to be the way 
It Is, and how staff and others are carrying out the program, 
to . determine what could be done to make the program- more 

effective for the students. 

\ 

The Guide for Collecting Information 

: . . 

i 

r k The guide for collecting Information about each criter- 
ion identifies areas of investigation, primary sources of 
"information, and verifying sources of information. The 
phrases in the ""Area of Investigation" column are directly 
related to the , descriptive^" paragraph* of the quality 
criteria. They represent (the major topics or themes under- 

paragraphs of each criterion. The 
>urces of .Information" Identifies 
either J>y observation or by group 
column, "Verifying Sources of 



lying the three descripti> 
second column, "Primary 
information to be put 
interview. 



Information" identifies substantiating facets that are to be 
pursued by observation^ interview, and document review. 
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In using this guide to find out "what Is** In the 
program under review end why It Is 1 that way, reviewers 
shetvld note the following Instructions: 

i ' 

e Choose which questions to pursue when and bow. In 
ao doing, allow the actual structure of the . 

~* classroosi — the activities In which students >are 
engaged at the moment — to guide the choice. Tollow 
the clues as they present themselves; do not try to 
pursue all questions to the same depth In all 
classrooms for all students and/or teaching 
staff. 

• The ultimate purpose of the review Is to judge the 
effectiveness of "what Is" as It telates to 
benefits for students. Do not use the questions as 
checklists or as lists of events whose existence 
{ j *ust be verified. 

e At/puch as possible, puriue answers to several ^ 
questions simultaneously. >Tfre Interrelationships 
among the answers are often more Important than 
verification that Isolated events are occurring. 
This Is especially true In linking instruction to 
support and In linking both Instruction and 
support to the Improvement process. 

e First, form a clear picture of what the program Is, 
then judge Its effectiveness. Do nt>t make 
judgments about the effects of Instruction on 
^ students, the effects of support on Instruction, or 
™ the effects of the Improvement process until ^ 
your picture of what Is happening Is complete. 
Premature judgments about effectiveness can * 
seriously distort both your further Investigation 
and your conclusions. y 



Opportunities for Improving 

Immediately following the guide for collecting 
information is a work sheet with opportunities for improving 
statements. These statements describe what the adults who 
provide services are doing or might do to achieve beneficial 
impact or effect on the client.. The intent of the quality 
criteria ratings is to live the school a status report on the 
effectiveness, of the current program. % The intent of the 
opportunities tor improving is to aid the school In moving 
from the current status toward Improvement by suggesting 
areas or) which the school might next focus In its ongoing 
planning progress. 

In selecting opportunities for improving, reviewers 
draw upon their understanding of the school program to 
identify activities that: 

* Would fbcus on the key or underlying cause for the* effect 
6n the client. 3 • 

- Would have the greatest Impact on *the program, leading 
to Improved effectiveness In many areas. 

- Would be the best next step to' take in an area "ripe" for 
Improvement — that 1.8 f where ^taff Interest and 
motivation in high, where there can be high yield for 
efforts expended and which Is small enough in scope to 
ensure success. 1 t 

The selected- opportunities then are expressed so as to 
recognize and encourage utilization of the schools/improve- 
ment processes of planning, translating and evalu%flon. 
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B. MAKING JUDGMENTS ABOUT PROGRAM QUALITY 



Judging program quality 

Over the course of the two or three days of -the 
review, thaw reviewers will bp pulling together 'the 
evidence they have collected Into a picture of the 
school' program. In asking a qualify judgment, the 
reviewers compare this evidential j>lct ure with the three 
descriptive paragraphs which anchor each quality 
criterion.. The revelwers determine the quality ratings 
by deciding which criterion description best fits their 
picture of*the school program. 

In making judgments about the quality, of each 
aspect of the school program, reviewers must adhere tot 
the following Instructions. 

0 

Responsibility for evidence and explanation 

quality of evidence 
, m the Issue of who Is 
responsible for providing evidence and explanation Is 
crucial* The fevlewers and the school must understand 
their respective responsibilities In establishing 
"proof." As used here, "proof" does not mean scientific 
or legal proof, but rather - "reasonable conclusion" 
based en the best available evidence. / 
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Generally, as the judgment goes from the middle to the 
high end of the scale for an/ particular criterion, the 
burden 9f responsibility shifts toward the^ school staff. As 
the judgment goes from the middle. t<f the low end, the bidden 
shifts to the reviewers. In making judgments, the reviewer 
should use the' following guidelines to ensure that the burden 
of responsibility Is placed correctly and consistently. 

e When evidence begins to Indicate that an aspect of the 
school program fits the higher end of the scale, the . 
school staff has a responsibility to provide 
Information, to direct the reviewers' attention to 
examples, and to explain how the program works for all 
the client* • The staff must also explain how the 
program reaches all of the Intended students, rather 
than just some. The reviewers have the responsibility 
for requesting and listening to these explanations, 
pursuing their Investigations' through observations, 
Interview, and record search, until they have enough 1 

f evidence to judge what Is going on In Instruction and to 
rate It accordingly. 

e When evidence begins to IndlcateHhat an aspect of the • 
school program fits the lower end of the' scale the 
burden of responsibility shifts to the reviewers to 
Identify the limitations of the program for the review 
criteria under consideration. That Is/ the reviewers 
must understand what Is happening and be able to explain 
the evidence they have found of lack of effectiveness. 
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NOTE: Lack of evidence of of fectlveness is quite 

different fro* evidence of lack of effectiveness. 
Failure to find evidence Is a failure of the 
review process for which both the reviewers and 
the school share responsibility. 

« * 

What to do when a program quail ty # seems to fit a 

mixture of descriptions • 

The quality criteria for Instruction are written In 
tens of an Individual student. In any school being 
reviewed, there will proba»l£ be sdmfi students whose 
instruction fits one description and other students 
whose instruction fits a different description^ TO 
determine how to judge- the quality and effectiveness of 
an aspect of the Instructional program whlch^i best 
described with a mixture of the criteria descriptions, 
use the following rules: 

e Virtually all students should be receiving i up t ruc- 
tion of high (or low) quality to judge as aspect 
of the instructional program as high (or low). 

e If the majority of students are receiving high (or 
low) quality instruction, the rating would be 
between middle and high (or low). 

e Use the middle rating for an even mixture of high 
and low 

Be especially alert to how the program Is meeting, the 
needs of the , educationally disadvantaged, limited- 
Englislr-proficient (LEP), gifted and talented students, 
and students with exempt ional needs. 
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Por any judgments of quality, the reviewer's primary 
responsibility Is to make the best possible judgment. Making 
judgments of quality is not just a- technical procedure, so' 
reviewers should not expect to give a technical explanation 
of how judgments were derived. The techniques described in 
this handbook are designed to ipprdVe the ability of trained 
'educators to gather complete information upon which to make 
judgments, and to pMEtde better feedback to the school, and 
to make the ^udgmenlKof program review necessary in applying 
the criteria, mor^^Mjistent . Nonetheless, these techniques 
cannot replac^^B^i ewer's owh ability* to make value judg- 
ments. 

Difficulties in Judging Quality 

Ho matter how well-designed the procedure or hoV 
well-prepared the revfewer, there,will always be difficulties 
in making judgments of quality. The difficulties have lead 
to different consequences fov each school. -Reviewers should 
be aware of these difficulties and the potential consequences 
of each at the school being reviewed. „ * - 

Ove r gehe r al 1 s 1 ng 

Necessarily, the review Is Halted to a "slice of time" 
sample of situations, time intervals, curriculum content, 
students, and so on* Merely assuming that this limited 
sample is typical is a mistake of overgeneraliaat^on. To 
avoid overgeneralisation, support the Initial generalisa- 
tions from observed samples by relating what students are 
doing to the work they are producing. The xT relate thia 
current work to samples of past work from the last several 
weeks. Discuss past/ and current work w^th the student 
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.as further clarification and support for generalizing # 
Discuss -the observed activities and students 1 work with 
the teacher, ' and (ask fo ^explanations of how the 
activities fit In wlYh the overall program for'the year. 
The teacher's explanation Is an Important- step In 
generalising. Finally, try to relate observations In 
the various classrooms to school vide, programs and plans 
for programs. Discuss this relationship m with the 
teacher, with people actlse^inv planning, and with school 
leaders; ^especially the ;\ principal,- By fitting 
observation and explanation together In this way, It is 
possible to construct a histor^qal picture of the school 
program and tie. It to the observed experiences of 
students. It Is this picture and the tier to students 
which, provide the framework for generalizing from 
specific observed data, . . 

Too impressionistic , * 

While initial iprdasions are a valuable gujde for 
pursuing a line of investigation, they should be 
validated or reject* by careful examination of 
approproprlate evidence, Thls~ evidence shou^ include 
teachers 1 explanations, students 1 work, or clas£fbom 
observation. Initial Impressions can be based tipon 
situations whldi are nit typical of the schopli Do not 
let these Impressions color the review without Aerifying 

Too analytic , 

The reviewer should noc just sgt upon the schaol as. 
o an ^active Information gatherer, ferreting and figuring* 
thf whbde time,- This can }ead to simply collecting dat^ 
foir' «Hk sake of data rather than- looking fi^the 
qua\{)Mfifre rfiect^ op the program. Reviewers Tho^ld^ 
jive the school an opportunity to disclose Itself In Its 
own^Vay. ' Reviewers should, therefore, spend some time 
qui^Tty allowing the atmosphere and felipo of life' at 
that School to present itself,. 
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Personal bias for <jr against specific materials or progr< 

Use the criteria and- procedures in this manual, 
4 Reviewers should keep in mind that "what would not work for 
me and mine might pork for them and theirs f " Reviewers must 
be certain to gbserve how a program works for the school, 
rather than judging how ft would or did work for them. The 
^ersonil bias Nwrror can go either way. - Just because a 
program was best for a reviewer at his or her school does not 
mean that It should be judged as effective In another 
school. m ^ 

False positive * * 

"* - 
This costly mistake occurs when a school staff Is 
a poor or mediocre job,- and the reviewer tells them thei are 
doing a very good job. When this* mistake Is made? the 
Incentives for improvement are undermined and the arguments 
for maintaining the status quo are reinforced .by the review. 

False negative ^ 

Although this mistake can be most, upsetting/ It' is not 
always as Sad 31 the false positive. Schools which are 
judged more effective that} the effect*, described in tjie 
a criterion paragraph are often" upset that they did not 
the top rating (just as "A" students ^omplaln the most 
*B+ H grades).. In many cases, these schools are strong 
amd corvfldent enough in their self -review to brush jpff the 
effect of - a false negative, 'In, some cases, however — " 
especla 1 ly in schools which have majje progress from a lower 
rdting to rftdQ14*oi abota--a false ne^atTVe^ rating can be 
demoralizing • , # . w - y 

Reinforcing facades . • W 

. Any type of grading system has aspects which, resemble a 
game, A costly mistake is the collapse -of the review 
process-whlch Is Intended to have a *r«Al and positive effect 
on the education of ♦ students — into a. game. While concern for 
"fairness" Is very 'important, It is less Ibpottant than 
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concern for the .real job of educating students. Over- 
attention to the technology and procedures of * program 
reviews may subvert the Intended effects on education, 
and create a -fair- but expensive and wasteful game. 
Some school and district personnel complain that trying 
to do* well on program review forces them to waste time' 
building facades Instead of teaching the students. 
Reviewers should not reinforce facade building In 
schools which want to do Well. Reviewers should 
concentrate on 9 students 9 learning rather than 
paraphernalia of Instruction. 



C. THE EFFECT OF INSTRUCTION ON STUDENTS 

This section contains seven quality criteria, each 
of which Is used to judge the effectiveness of an asj>ect 
of the student's instructional program* Each criterion 
la accompanied by a guide f6r, collecting Information 
relative* to that criterion and a ^set of opportunities 
for improving that area of instruction. 

The first three criteria are used to judge the 
effectiveness of the instruction receivejl by all 
students participating in the planned program including 
limited-English-prof ident, educationally disadvantaged, 
gifted and talented srtudents K and students with excep- 
tional needs. The- criteria, are; 

• How Students kre Learning 

• What Students Are Learning 

• The Environment in Which Letting Takes Place 

The next three criteria are used to judge the 
effectiveness of the Special services provided students 
with special needs. These criteria aje: 
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• The Effect of Excess Cost Services on Educationally 
'Disadvantaged Students 

s 

• The Effect of the Bilingual Services, on Limited- 
English-Prof icient Student 8 f 

• The Effect of Special Education Services On St^Rf^ts 
with Exceptional Needs y 

The final criterion is used in schools receiving School 
Improvement funding to "judge the effect of the total program 
on c he student. It includes all areas of the curriculum and 
all services received by the student over time, applies 
to each student participating in the planned program. The 
criterion is: 

• The Effect of the Students Total Program on the 
Student 

This part of the review focuses on the individual 
student. Each area of instruction must be viewed from the 
perspective of its impact 6o t£e, learning of each student, 
including LEP, educationally disadvantaged students, students 
with exceptional needs*, and gifted and. talented students. 

How To Look For The Effects Of Instruction On^Students 

.Each participating classroom, resource specialist room, 
rooms or areas where other special education services are 
provided, library and/or media center and resource cent*r 
and/or learning -laboratory must be ^pelted. It . is 
reqpmmendmd^that 20 minutes be devoted to the initial visit 
to each classroom, fot all of the areas of investigatidn 
identified in the guide for collecting Information need tQ bp 
explored in every classroom, but each should be verified in 
several classrooms. Classroom visits should be structured td 
make the most of the tine available. - ' 




Upon entering -the classroom, spend a few minutes 
developing and understanding of what is happening within 
the classrooa: 

e look art the physical environment 

• Observe the students and what they are doing 

f Observe how students are grouped and how Individual 
assistance, is p^ovidejl^^ ^ 

• Observe the teacher, aide,, and #thec" personnel 
(patents, tutors , support staff) "as they work with 
the students 

• Listen to the questions asked by students and the 
responses they recelvf 



Remember at this point that, as. a reviewer, you are 
putting together an initial picture rather than' making 
judgments; each Impression will need to be verified 
t hr ough further ooservacion and informal" Interview as 
well as through other sources; and that first impress- 
ions may be Influenced by personal .Mas. 

Using clues gathered while putting together the 
initial picture, select a -few students for in-depth 
study, including one or more with special needs, such as 
educationally disadvantaged, gifted and talented, LEP 
students, and students with exceptional needs. 
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BASIC CLUES FOR UNDERSTANDING INSTRUCTION 

• Wt\£t are the students doing? 

- Receiving instructio/i 

- Applying skills 

- Discussing concepts * 

- Acquiring information 

- Waiting 

- Playftfs* 

- Practicing newly acquired skills 

- Teaching each other 

- Synthesizing and evaluating information 

- Watching 

- Attending to an unrelated task 

- Causing a disturbance 

• How much time Is actually spent on assigned activities? 

• How much time Is the student receiving attention from the 
teacher? 



• Is the teacher's attention for instruction, providing 
^personal reinforcement, or ottier purposes?* 

• Are other adults (aides, volunteers, special education 
teachers) present to provide. special assistance? If so, 
how do they spend their time? 

• Are students with expect lonal needs Included in appro- 
priate ways? 

• What are tb* activities of Title I/SCE students? 

• Is the content for >each student challenging, but not 
defeating? 

• 'Is there support for LEP students through materials, 
aides,. . etc? Is this support 'appropriate to the students 
receiving it and the Instructional setting? 

• Do students complete one astflgnmen£ before they begin a 
new assignment? If they finish early, <h> they use extra 
time productively? ^ * * 4 
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THE EFFECT OF INSTRUCTION QR STUDENTS: HOW STUDENTS ARE LEARNING 



This criterion 'focuses on the extent, to which the 
instruction received by each student is responsive to his 
or her needs, strengths, interests and ways of learning, 
thus enabling hi* or her to be successful as a learner. 

How students learn involves instructional issues such 
as: (1) responsiveness to individual student nfeeds, 
strengths, and interests, and ways of learning; (2) the 
activities in which students are engaged (including 
materials, instructional methods, and grouping); (3) use of 
time for activities (4) extension of learning; and (5) 
opportunities to apply skills* and knowledge learned In one 
area of the curriculum to other areas. * 

NOTE: The term "ways of learning" Includes the setting in 
which a student learns best, such as more or less 
structured, independently or in a group, as well 
as Jiis or her preferred methods of receiving and 
o/ocesslng information — visual, auditory and/or 
kinesthetic. y 

In determining how students learn, focus directly on what 
the individual students are doing rather that on how the 



adults are teaching. Determining what adults do to 
make learning happen Is used to test and verify 
what you find the students doing. Thus, the 
Investigations *{>egln with what the students are 
doing. 

Note that a key indicator of student learning 
Is the extent to which his or her instruction 
matches his or her needs, Interests, strengths, and 
ways of learning. The clues that you have gathered 
through initial classroom observation will give you 
some indication of how responsive the instructional 
program Is to student needs.* Follow those clues to 
determine how res A naive instruction is 1 to the 
individual stude^n in your sample. Then seek 
additional information that will enable you to 
generalize from your sample students to the 
classroom as a whole. 

. Apply the criterion How Students Are 
Learning to each, area of the curriculum under 
Review. 
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CURRICULA"' AREA 



CRITERIA FOR JUDGING QUALITY 
I HE EFFECT OF INSTRUCTION ON STUDENTS: HOW STUOENTS ARE LEARNING 



Thi. criterion fbcuses on the extent t«j \+g'^**g^ n $& 
h«# Mrfi AK^tent is resoonsive to his or her neeos. sirengins, a^ci 
&r&^2SVf ■ hSXS thus enabling h\m or her to be successful 
as a learner. 



m *»lvina this criterion consider: (D The planed progra* beihQ 
&2&e7 this $rT use • separate paoe for e^cu^ultr erM, 
w^tina the ne*e of the curricuiar area In the A 2 Lj» 
students *rtteipttinq- in the planned pr*r*n, J^^ 1 £jt^d 
receiving special services (giftedand talented, LEP, Title I/SCE, and 
students with except ignal needs). 



The student Is restless and not interested 
in the learning activity In which he or she is. 
engaged. Me or she is not attending to the 
teak an) is frustrated by the learning 
activity. The stufent is confused about what 
to 0o br how to d* it and (toes not know the 
purpose of the activity. Instrud-ional. 
activities for the student are frequently the 
saw aa those tor * his or her. claawetea, 
without recognition of his or herVjeeds, 
strengths, interests, and ways of learning. 
Opportunities to practice skills and concepts 
are" limited; many skills and concepts are not 
being westered or extended; and continuity of, 
learning experiences is lost thtou^ 
interrupt lone. Opportunities to apply skills 
and concepts in other curriculum areaa are 
limited; each curriculum area is treated as 
separate fro* Others. The personal and social 
needs of the student are seldom considered by 
starte>when planning his or her learning 
activities or assigning hi» or her to groups. 



The student \ interested in the ectivity in 
which he or she is engaged and generally is 
attentive „ to the task; there is little 
interruption due to confusionlbout what to do 
and how. to do it. The Materials the student 
uses and the activities in which he or she is 
engaged generally fgtch his or her needs and 
strengths; materials and methods of 
instruction semtims take into account the 
ways in which the student learns and his or 
her educetional interests. Student work 
indicates that he or she experiences success 
in learning the necessary skills and concepts 
of the curriculum and has some opportunity to 
extend, bring together, and apply the sktlls 
or concepts. .There is an indication that the 
personal and social nieds of the studftnt are 
considered by staff when planning for his or 
her learning activities and when placing him 
er her within groups. 



The student is actively engegeiJ In learning 
activities; he or she is attentive to the 
task,' end his or her interest end wot i vet ion 
for learning 1* high. The learning ectivltes 
arc not only jhallenging for the studtnt, but 
afso are successful learning experiences. The 
mte'riels that the" student usee end the 
activities- in -wh ic h h e a r s he I s -en gag ed itch 
his or her, pert iculer interest^ end ways of 
leemlng as well as his or her needs end 
strengths. Stucent work indicates that the 
student has sufficient opportunities to 
prectice, extend, bring together, end apply 
the identified tJdllt end concepts of the 
curriculum; he or she .knows the purpose of the 
ectivity and expects to achieve that purpose. 
The settings in *Mtf> the student iorto and 
the-rorking relet ionship with other students 
jnd edults encourage the personal and eociel 
development of the student es well es his or 
her acquisition, extension, end application of 
skills end concepts of the curriculum. 
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GUIDE FOR COLLECTING INFORMATION ABOUT HOW STUDENTS ARE LEARNING 



Area of Investigation 



Activities In which the 
student is engaged 



. ( 




Primary source of Information: 
classroom observation 

Arrf the students working on the sane skills, 
using different activities in recognition of 
their different ways of learning? 



How are teaching me t hod s 
what is to be learned 
strengths of each student? 



varied according to 
and the • needs and 



Are students at all performance levels Involved 
In challenging and productive activities? 

To what Extent is instruction leading to 
accomplishment of objectives (in IEPs, ILPs, and 
other individualized progr ams)? ^ 

Are students at some levels limited to passive 
teac hing, .suc h as repetit i ve desk activities? 



Verifying sources of information : ' 
Interviews/documents 

Explore with both teachers and 
aides : The role of the classroom 
aide; how the aide assists the 
student; who diamines ifhat the 
aide does with 0om and how; who 
determines what Wbe student does; 
services for Title I/SCE, . UBP, 
gifted and talented, students with 
exceptional .needs and gifted 
students and , talented; who 
determines what the needs will be 
and how they will % be carried out? 

Explore with support staff ; How 
support staff are Involved in 
determining what students do; what 
they do^dlrectly with students, how 



Tq whaT^ extent is direct instruction a part of 
the student's dally instruction? 1 

Does the student understand what he or she is 
expected to do, how to do it, and why? 



"tKey accommodate different learning 
styles, needs, and strengths of 
students 




Can the student relate what he or- she 
to what he or she has done or will do? 



Has the LEP student understood directions for 
|he activity and what he or she is to do? 

(toes the LEP student receive Instruction In his 
/or her primary language? Is that language used 
in a way which supports learning in the various 
subject areas? 

In what kinds of compensatory activities . is the 
Tltls^I/SCE student Involved? Dothey appear \o 
»t his or her needs? 

11-10 



Explore with classroom volunteers ; 
How .classroom volunteers assist the 
student in learning 

Documents : List of Title I/SCE, 
LEP students; teacher aide lesson 
plans, IEPs, ILPs, student records 
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Area of Investigation 

0 

Materials the student Is 
Is using 



Student success as 
a learner 
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primary source of Information ; 
classroom observation 

0 

How students are grouped? How flexible Is th6 
grouping? " * 

Are the materials used In the Labs and Resource 
Centers adapted to student needs? 

Do the materials" fit Into the purpose of the 
activity? 

Is the student using the materials to accomplish 
an Intended objective? 

Do the materials match the studeitt's needs , 
strengths, Interests, aftd ways of learning? 

Is a variety of 
same skill? 



Verifying sources of information ; 
Interviews/documents 



iterlals used In teaching the" 



Are appropriate materials, media, and equipment 

, va <i a wi e the clsggroom for LEP, title I/SCF., 



and Individuals with exceptional needs to meet 
/ stated objectives? 

Does tKe student know who will look at his or 
her work and when? 

Does he or she know what happens if the work is 
not done correctly? 

Does the way in which, the student receives 
feedback reinforce* learning? " 

How timely Is the correction of student nejk? 
Does' the student's work indicate general 
success, 4 repeated failure, or repetition of 
skills already mastered? 

Does re teaching take place when * student's work 
indicates .the need? Who does it? 

Will the studen^learn the prescribed skill oir 
v concept by doing the assigned activities and 
using the assigned materials? 



r 
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Area of invest igat 



id social nec 





.Personal and social needs 
. of the indent 



t 



-Student opportunity to 
apply and extend 



■vat. 



Primary source of Information : 
classroom observation % 

Is there evidence that the staff recognizes th£ 
personal/social needs of the students? 

Do the students work -well together? 

* 1 1 

Is there evidence that students are learning to 
become socially* responsible? „ 

>* • 

How do the working ' relationships between 
a teacher/aide appear? Teaeher support 4 staff; 
aide /volunteer; adult/student; student/student f 
and so forthj * * - 

• How does the student apply whl£ has been learned 
in 'other areas of the curriculum? 

0 • 

Are thefe a variety of approaches for a student 
to use in applying learned basic skills? 

Dqes each student r including LEP, educationally 
disadvantaged, gifted and talented, and . students 
. 'with/ Exceptional needs, extend and apply skllj 
appropriate to his or her level? Are t| 
extension or application activities for reme< 
instruction? ' ' . 



Verifying sources of information ; 
interviews/documents * 

Do^umepts : Assessment information 

including self-concept inventories; 
psychologist, nurfre records; IEPs; 
absentee^ tecords. • * 




^Explore with students : What 
textbooks ^rtl— -materials students 
use and how often, what other areas 
of the curriculum they experience * 

re with . teachers : ' How 
r ferent basic skill , levels "are 
accounted for In other areas of the 
curriculum; what techniques ane 
used'ito encourage students to appj^ 
basic skil^m* 

Documentation P teacher lesson plan 
book, learning centers, variety anjl 
range q£ books and materi^s, IEP. 



/ 
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OPPORTUNITIES FOR ItfTOVING HOW STUDENTS ARE LEARNING 



The statswnts listed belo* indicate actions wMcti may have been or 
need to be taken to Improve the effectiveness of your program. The 
specific opportunities selected by the reviewers -reflect theii; 
understating of your program anjj their best suggestions for * at your 
next st*>s mi^it be to make your program more effective for stu<*nts, 



a. - Ensure that those who work with students Know eac* students needs, 

strengths, and interests, 

b. Determine what each student has levied and has yet to learn i in each 
of the acadsnic areas addressed in the school, plan, and aH indi- 
vidualized , learning plans. Reexamine such , assessment frequently 
enou^> to be current with the studsnt's growth. 

c. Assess earf* student's social and- personal development, including 
awareness, knowledge, and understanding of different ethnic groups. 



d. Pled each student's daily work based on assessment of what .the 



student already k>ows and has yet to laarn, his or her Interests 



e. 



f. 

Q. 

h. 

d. 



and str*gths, and the way in which he o^phe learns best. 

Group vvj regroup students in acoordance with their ne*Js, 
strength*, interests, ways of learning, and what is to be learned 
(consider individual learning, small group, large group,- whole 
group). 

Use a variety of teaching methods to .meet each studsnt's heeds, 
strengths, interests, and ways of learning. 

Use materials activities which allow students to buiW on £heir 
strengths and interests. 

Set *>propriate standards and expectations fbr all studsnts,, anffl' 
make those cl*ar to the students. jl 

Manage instruction in ways which minimize disruptions and *llow 
students sufficient time to abquire, extend, and apply the skills 
and concepts of the curriculum. 



J. ProvIoVtimely feedback to students about their work. 1 



k. 



Provide opportunities for students to practice and apply, skills -and 
concepts being learned ' " 

Coordinate and use all availAle resources so that , ^terials, 
talents of parents and community memtters, and special skills of tne 
school staff Support eadr^studsnt's continuous progress. 

E/S 



staff and others at the school. The SSC/SAC/BAC along with other staff 
and parents should review these suggestions, deteiwine their potential^ 
effectiveness for program ipprovement, and then decide how your ongoing 
planning, translating and evaluation procedures * will be 4|5d to 
incorporate them into your program. 



Selected Opportunities for Improving 
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Guide for Collecti ng Information To Determine Opportunity For f Improvlng How Students Are Learning 



After observing the students at work and talking to 
the* about that work, continue your Investigation to 
determine what has created the effects you have 
observed. Look at how the students are assessed by the 
teacher to determine what they have learned, what they 
,need to learn, and how they learn best,. Look at how 
assessment • Information Is used to determiner what the 
students should do and titfw they should do It, Look at 
how students and adults are spending their time. 



Use the Information gained In this part of yoiij: 
Investigation to Identify opportunities for Improving, 
the effects of how studenjts are learning. As you 
proceed through the review, use this same 
process —finding ogt what Is , Identifying the 
effect of what Is, aria then Investigating why. the 
effect Is as It Is — In order to suggest opportunities 
for Improving or sustaining the effectiveness of each 
aspect of the program. 



Area of Investigation 



Student assessment 
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Primary Source of Information : 

Classroom observation ^ 

Is Information collected about the academic 

progress of the students In all subject areas?/ 

(as appropriate for students with exceptional 
needs)? 



the student 's 



Is information collected about 
personal and social development? 



Is information collected by testing and observ- 
ing; by analyzing, students' work; 6y conferring 
w^th parents, students, and/or other teachers? 

If assessment is made by other than the class* 
p room teacher, how does the assessment informa- 
tion become part of the teacher's working know- 
ledge of the students? , 



t 9 
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• Verifying Sources of Information ; 
interviews/documents 

Explore with teachers and support 
staff ; How the methods of, assess- 
ing students wertf designed at 
selected; how the Information Is 
used; how often reassessment occurs 
and why; how consistently the 
information is used (from class and 
grade to) grade); how\ helpful 
assessment information is in guid- 
ing the learning of students; how 
the Information is articulated 
(from grade to grade and classroom 
to 'resource or media center). 

Explore with aides ; How aides are 
Involved in assessing students* 
needs , strengths ,* and ways t>f 
learning; their responsibility for 
maintaining any records; how they 
codmunlcate what they learn about 
students to the teacher . 
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Area of Investigation 



Primary source of Information : 
Classroom, observation 

Do teachers, ai^es, other teaching personnel, 
and students conduct ongoing assessment? How 
timely are the assessments^ 

How is ongoing assessment Information being used 
to decide the activities in which the student 
should be involved and the materials he or she 
should be using? 

Do students participate in their own Assessment? 

How Is assessment Information transmitted 
between classroom teachers and specialist 
teachers? 

Is only pertinent information shared , thereby 
respecting confidentially • or personally identi- 
fiable infotjMtion whenever possible? r 

it there 1* an indication that a student may 
need special education, does the regular teacher 
know the referral procedure?/ 



Verifying sources of information , 
interviews/documents " 

Documents : Teat scores; claasl- 
fied/individual student progress 
records; personalized teacher 
record keeping system; report 
cards; survey data; any, other 
assessment information; support 
sfaff retords of student progress 
and articulation or communication 
with classroom teacher ; individual 
assessment plan. 



How the classroom is 
organized and managed 
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Does the regular teacher participate in the 
special education assessment of individuals with 
exceptional needs? ^ 

How does the teacher decide with whom the 
student will work (teacher, aide, volunteer, 
peer)? How are decisions made about who works 
with educationally disadvantaged, LEP, talented 
and* gifteJ students', and students with 
exceptional needs. 
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Area of Investigation Primary source of Information : • Verifying Sources of Information 

cla ssroom observa tion Interviews/doc uments 

How groups atp established Are decisions basal on .tasks and concepts Sr Explore with * teachers : How 

8kllfs~~to be taught? On personal, social! aca- students are grouped; how flexible 
\ demlc needs and .strengths and language abilities the grouping Is; hqp he or she 

( ♦ of the students? On the capabiliy*| of the determines the activities each 

/ adult(s) who will work with the studenre? student or group of students should 

be engaged In; how he or she works 
Do - practices allow .for movement In and out of with the student or groups of 
groups as Indicated by Individual needs? students; how he or she works with 

the aide; how what the student? "a A 
How are students with exceptional needs, LEP, doing now *fits "Into a larger 
* Title I/SCE, gifted students, and so forth, timeframe: the' last few weeks ocT 
grouped for Instruction? the plan for, the year. 

flow Is current assessment Information uaed In 
determining their grouping? ' 

t 

Do students have the opportunity to work with a 
variety of other students In both social and y 
academic settings? . " 

Ifap the classroom schedule Are^ decisions about the classrom schedule based 

Is determined- on the task, skill, or concept to be taught T~ On * 

personal, social, ^adealc rfe'eds and strengths 
end language abilities of the students? 1 



Does the schedule provide adequate time for les- 
sons (complete Introduction and sufficient 
exploration/practice In order to maximize 
retention)? 



Does the schedule provide adequate time for Documents : Lesson plans, written 
completion of the assigned task? . classroom schedules, IEPs, IEPs. 

What curriculum priorities does the schedule * 
reflect? Is adequate tliie allowed for other 
areas; e.g., fine arts, social studies, and 
science, as well as basic skills? Is time 
allowed for personal and social development 
activities? Is time allowed for English-as-a- 

second language and/or primary language OO 
62 - instruction? • 
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Area of Investigation 



How student learning 
activities are directed 
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- Primary source of information : 
' classroom observation 

How does the teacher make decisions about 
what activities should be extended outside the 
classroom and how? 

How dipes the teacher use his or, her time? In 
direct instruction with students; in planning 
lessons; in response to student requests for 
help; In planning for instruction; in directing 
the ^tudents; in directing other adults, aides, 
andwolunteers? 

<■ 

Hoy do the aides use their time? In working 
with students individually and in grpups, In 
preparing materials, in implementation of IEPs 
and ILPs, in recotd keeping? How, does the aide » 
plan with the teacher? 

How does the teacher ensure that the time the 
student is * engaged in learning activities Is 
sufficient to learn what is to be learned? 

3 

Do^ spguifle groups, such as .individuals with 
exceptional needs, LEP, Title 1/ SCE and gifted, 
tend to receive most attention from either the 
teacher or the aide? * 

How are decisions made about what materials the 
studerft will use and* in what kinds of learning 
activities he or . she dill be involved? Who 
makes them? ' 

T6 wtjat extent are the decisions based on know- 
ledge of vhat the student has learned and needs 
to learn* next? 

If taXework is assigned, is it for all students 
or some students? How is information about 
hoaewprk fed back to students? Is/it timely? . 



V^rifyinfi Sources of Information 
Interviews/ documents 
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THE EFFECT <OP INSTRUCTION ON STUDENTS: WHAT STUDENTS ARE LEARNING 



This criterion foe use? on how effective the instruc- 
tion received by each student in each currlcular area is in 
enabling him or her to acquire successfully necessary 
skills and concepts of that particular area and to apply 
them tp other learning. 

Wha$ students .are learning Involves issues of curri- 
culum 7 completeness of content, Identification of skills 
and concepts to be learned in currlcular areas Included in 
the planned program and individual learning plans, and the 
range and depth of content available for Batching the 
range of student needs, capabilities, and educational 
interests. - For purposes of the review, curriculum is 
defined as the instruction in skills and concepts that 
students actually experience rather than as the school's 
or district's course of study. 

In order to develop a more thorough understanding of 
instruction, evaluate the curriculum as it exists for the 
student and determine how decisions are made about what the 



student will learn. f»lan to observe instruction in 
each of /the curriculum areas under review. 

During classroom observation, look at the part 
of the curriculum in which the. student is working 
during classroom observations. A review # of the 
student's past work and individual learning plans 
will give clues to what skills arid/or knowledge 
have been taught • A review of tbe^fclMstbom 
materials and skills and concepts to/*e m learned 
will give clues to what is being /and will be 
taught. Determine whether the subject matter [area 
is broad enough in scope to be appropriate f off all 
students in the classroom, including * 4 those 
receiving special services (gifted and^talented , 
LEP, special education, Title l/SCZK * » 

Apply the criterion for Students Are 

Learning" to each area of the .curriculum under 
review. 
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CLKRICULAR ARI 



•CRITERIA TOR JUDGING QUALITY 



THE EFFECT OF INSTRUCTION ON STUDENTS: *HAT STUOENTS ARE LEARN I hC 




Jb4s- criterion focuses on how effective the instruction received by 
etth student In each curriculum area is i* erwbling him or her to 
-acquire^ successful ly the necessary skills and concepts of that 
■ particular area and to apply them to other learning: 



•In *>plying this, criterion consider: (1) The planned program being 
implemented tfcis year; use a separate page for each curricular area, 
' writing, the name of the -curricular area Jn the spacevjfrove, (2) AU 
students participating in the planned pfbgram, including -stucjents 
receiving special services (gKted and talented, LEP, Title i/SCE, and 
^^tu^ents wjth exceptional needs h 



\ t The curriculum ^Jct> the- „ Student is* 
experiencing is incqmplete; the student does 
not receive instruction in* all ^appropriate 
~* * areas within the curriculum. The work of the 
student indicates that the skills and ooncepft 
^yfm or she is to leam are not clearly defined 
and that standards and 1 * expectations are low. 
The student 1 s *oik ^l'so indicates that the 
teaming experiences of the student tehd to be 
too easy and repetitious or too difficult and 
" frustrating. There are few opportunities for 
the development of critical thinking *ills 
-and Independent Judgment included in the 
curriculum. > J 




hgy£ 
stgdent aecpl 
skills and 
experiences ai 
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^The curriculum whicti the student, is exper-\ 
iericing is complete in most major skill, areas; 
in some areas, it lacks sufficient range for 
the student. ^^ihe most ^ssential -skills and 
curriculum frive been defined, 
jards and expectations. The 
instruction in the essertial 
5ts; higher level learning 
limited. The student's daily 
work- often is sufficient .tk challenge his or 
her Ability and io provide^firoductive learning 
experiences. Some opportunities are* lyovided 
for students to develop critical thinking 
skills and independent Judgment/ but; indica- 
tion ape that development of the, desired 
skills of critical thinking and independent 
Judgment .are limited. 



T 



The curriculum tfhfch the stutter* is experi- 
encing is complete 4 in the jmajor ^cill and 
concept areas, with sufficient range to pro- 
vide for xonjtinuous progress for the student. 
The iretructibn received by the student 
includes' essential skills' and concepts • and 
higher level experiences #Mc* bring together 
the various skills and concepts of the curri- 
culum area and whicfi integrate them throu^i 
V^her curricular areas. mt>at trie student is 
to learn is clearly defined, as aye adiieve^ 
ment standards and expectations. The student's 
daily .work* is at a level of dif fioflfc^jMch 
both Challenges the student to leiMwrT grow 
and provides experiences of suRess and 

* competence in, learning. ' • There is evidence 
that the student is using critical thinking 

• skills *^xJ independent Judgment and has 
opportunities to pursue educational interejfes. 

• I - 
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GUIDE FOR COLLECTING INFORMATION ABOUT WHAT STUDENTS ARE LEARNING 



Areas of Investigation 
The curriculum 



Primary source of Information: 
classroom' observation 



Verifying sources of Information: 
Inter view/document 8 




What skills and concepts to be learned have been Explore wltfr teachers and support 
Identified? ^ .staff: How m declclbns regarding 

, curriculum, textbooks 9 ' and mater- 

Does the range of the skills and knowledge to be lals are. made; hov curriculum Is 
learned meet the needs of sttrifents? modified or expanded to a meet the 

needs of students receivfiM special 
How does the curriculum provide for experiences services,- how .those decisions are 
which brjng together £he various Separate skills made; what opportunities /there are 
and concepts? to Integrate various /curriculum 

areas jiot observed In ttfe classroom 
What kinds df alternative activities and . . • * k % 
approach^ are available for students who have Explore with district staff : How 

ons a\ovt curriculum, text- 
and' materials are made; how' 
school staff Is Involved In 
decisions - , - 



(difficulty mastering skills and concepts on the 4 
first attempt? .... 

■ / * A ft 

How are opportunities provided for students to 

apply the skills they are learning? " . , 

* . Explore with teachers , Qldee t 
, , How does the curriculum reflect the* needs and syppftrt staff, and student's : How 
strengths 4 <ff students? Are alternatives and standards and expectations for 
accommodations available to students receiving students "were developed, ^iow con- 
special service?? slstent they are throughout the 
• ^ * • ' school; ho^ry^ultably they are 
andards-^and expectations What standards and expectations for student per- applied; who- is responsible for 

foraance have been established? What are the maintaining standards; .how and when 

proficiency ftandards?: * parents are involved. * 

jt » \ ' 

Are standards ,kn6wn to the students? To parents? Dqcumertfa : School plan, continuum, 

* . * * „ all individual learning plans, 

f "Do the standards afld expectations permit each notes home to parents , mandated 

- • student to experience success? * proficiency .standards, and required 

^ * » . dlfferen tandards; courses -of 

'1 Is the student expectmd to # exhibit* quality study, textbooks, curriculum 

workmanship at a leyel^at which he or rfie is materials, \.lEPs, ILPs, and other 

Working? * N learning plans. 
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Area of Investigation 



Primary sources In Information: 
classroom observation 



How the curriculum Is How Is the' curriculum coordinated within a 
coprdinated and articulated grade level? Between grade levels? How does itV 



amo^g teachers 



Critical thinking skills 
and independent judgment 



72 . 



allow continuous progress for all students? 

How do the classroom teachers and resource or 
specialist teachers work together to ensure 
continuity of learning for students? (Consider 
all students receiving special services-^gif ted 
and talented, LEP, educationally disadvantaged 
students, and students with exceptional needs.) 

Ti what degree are all appropriate staff 
Involved in developing and reviewing individual 
learning plpns (IERs)? How ate parents 
Involved? 



;udent have to 
>ropriate to his 
ability to 



What opportunities does the 
make decisions and/or chblces ai 
or her performance level 
function? 

\ V . / 

Are there'signs of leadership jresponsibilities, 
task responsibilities, and so forth? 

What klndf of activities aii»s*aterlal8, are 
there that provide students -wTth ^opportunities 
to make judgments and « to apply higher level 
thinking skills?" 

What kinds of opportunities are there for the 
development of critical thinking and independent 
judgment for all students, including LtfP, . 
Title ; I/SCE, gifted; and students with 
exceptional needed ' 



Verifying sources of Information: 
interviews/documents 



Explore with teachers and support 
staff : How the records of ptfpll 
progress are ^esigittd, monitored, 
evaluated, articulated, and 
modified 'throughout the school* 



Explore with teachers* aides, 
staff, and students: The 



su 



pport 



ways (not easily observable in the 
classroom) In which students are 
challenged to \ extend their 
learning; how they are involved in 
critical thinking activities, 
decision making, leadership, 
Independent judgment, and pursuit 
of their own interests 
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CPPOR UNITIES FOR IMPROVING WHAJ STUDENTS ARE LEA WING 



The statements listed below Indicate actions which may have been or 
need to be taken to Improve the effectiveness of your program. The 
specific opportunities selected by the reviewers reflect their 
understanding of your program and their best suggestions for *iat your 
next steps might be to, make your program more effective for students, 



a. Develop the curriculum by adding the missing skill and concept areas 
or by extending the range or depth to peimit the continuous progress 
of each student, ^ 

b. Identify speciflb skills and concepts within the curriculum. 

c. Identify specific skills and concepts needed to achieve the objec- 
tives of individualized learning plans, defining academic standards 
and expectations. 

d. Use the identified skills and concepts in planning daily instruc- 
tion, * 

c * ^P^jfe ygj*^ ies ^ f o r thc development of critical thinking skills 
and independent Judgment • 

f. Est*>lish coordination among classroem teachers at various grade 
levels/departments. 1 



Establish coordination between 
and/or specialist teachers. 



c las stood teachers and resource 



h. Include activities that are designed to develop and extend student 
a w aren ess, knowledge, and *>predation of other cultures. 

1. Include in the curriculum planned activities that are designed to 
develop the personal and social skills of students. 

J. Preside opportunities for students to develop* and Increase their 
skills and toowled^e in many curriculum areas. 

k. Integrate the skills of reading, language, and math throughout the 
curriculum areas. 

1. Preside activities that challenge and motivate. 

m. Use school, district, SESR, consort ia, county prpgram improvement 
resources in curriculum development). 



staff, and others at the school. The SSC/SAC/BAC, along with other 
staff and parents, should review these suggestions, deteimine their 
potential effectiveness fox program ipprovement, and then decide how 
your ongoing planning, translating and evaluation procedures will be 
0sed to incorporate them into your program. 

Selected Opportunities' tor Improving 
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A. 



THE EPFECT OF INSTRUCTION ON STUDENTS: THE ENVIRONMENT IN WHICH LEARNING TAKES -PI^ACE 



This criterion focufes on how effectively the school 
and classroom environment supports and s encourages each 
student's academic, personal and sdclal growth. 

To find out how the learning environment affects the 
students , observe the classroom environment and the activi- 
ties in the classroom. Talk to the students. Find out how 
responsible they feel for their behavior and for the 
behavior of others. Who sets the standards of behavior? 



What do they think about the physical arrangement 
of the classroom? What do they think about their 

school? * * 0 

Observe the total school environment. Ss» Hw 
the adults and the students ^interrelate on the 
playground and In the cafeteri^ the halls, and the 
teachers 9 room. Observe the physical plant, the 
playground , the of f fee the nurses room, and the 
cafeteria. How. does the environment support^ 
student learning and growth? 
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* ' CRITERIA FOR JUDGING QUALITY 

T£ EFFECT GT INSTRUCTION OX STUDENTS: THE ENVIRONS NT IN WHIOH LEARNING TAKES PLACE 



.This criterion focuses on how effectively the school and classroom 
environment supports and encourages each student's academic; personal 
and social growth. 



In ^plying this criterion consider: (1) Classroom envirconen^, and 
(2) school environment. Be sxe to* include all participating jtudgrts, 
including students receiving special services (L£P f gifted ana 
talented, Title I/SCE, and Students with exceptional needs). / 



/ 



Students in their learning settings appear 
t» be bored with or hostile toward the 
learning activities in rf>ich they are engaged; 
they do not perceive school as a place to 
learn or pursue learning. The atmosphere is 
tense nd "there is disruptive behavior and 
fear for physical or emcfciorf|al, safety. 
Stvtiards nd expectations for ach lament and 
brfwldr are generally low and erratically or 
lnequit*>ly enforced. Thefe is little respect 
Wong or between students and staff; they do 
not expect much out of the school either for 
themselves or fbr others. Ethnic, social, 
economic, language, physical, and sex 
differences among, students and staff are 
ipored *ti misunderstood. There is evidence 
that the atmosphere and physical environment 
of the classroom and school inhibit students' 
full participation in learning. 



Studfents in their learning settings appear 
busy ^completing their assigned work. 
Standards and expectations for achievement and 
behavior provide a challenge for many students 
and kre generally applied in a consistent and 
equitAle manner. There il an atmosphere of 
courtesy among students dnd staff and of 
compliance with school rules; students have 
freedon for self-expression ant* for 
interact inn with other students; the school 
t akes 'sane ini t iat i ve to support the ir 
personal and social growth. Ethnic, social, 
economic, language, physical, and sex 
differences among students and staff are 
recognized and understood. There is evidence 
that thq atmosphere and physical environment 
* of the classroon and school allow students' 
full participation in school life. 




In their learning settings, students Appear to 
be motivated and exhibit initiative for 
learning; they perceive school as a place that 
encourages and supports self -direct ion in 
pursuing educational interests. Thte atmosphere 
yxl nood are friendly and supportive of both 
academic learning and personal and social 
growth; styxlaids and expectations for 
achievement/ and behfVior are hi£> and 
equitably'' applied. There is an atmosphere 
among students and staff of respect for self, 
for others, and for the school; they are 
enthusiastic *>out their experiences at 
school. Ethnic, social, economic, language, 
physical, and set differences among students 
and staff are respected and appreciated. 
There is . evidence that the atmosphere * and 
physical environment of the classroom and 
rhbolVnhance students' full participation in 
ol life. 




Area of Investigation 

The atmosphere of the 

school/ classr ooa 



Primary source of informations 
schoOl/classroom observation 

How do t^je adults work together? 

How do the students work together? Do they 
cooperate In carrying out group assignments? 

How do the adults^ at the school , Including 
secretarial , janitorial, food services , and 
other support staff Interact with the students? 

How do the administrators at the school .Interact' 
with the students and under what conditions? 

How are the standards of behavior determined 
within the classroom and outside the classroom? 

Hoi) are the standards applied? By whom? 

Is the application of standards equitable? 

What kinds of activities are there that support* 
the personal and social, development of the 
students? Are such activities available te 'all 
students? 

How well do students^ accept responsibility for 
assignments?. 

What kind 8 of. opportunities are provided for 
student 8 to develop and utilize 'their strengths, 
talents, and interests? 

What kinds of self-di recti ve activities are 
available to students? 



Verifying sources of information; 
A interviews/documents 



Explore with all 



Pol-level 
Kinds of 
It support 



personnel and parent! 
schoolwlde activities 
the personal and social growth of 
students; how decisions are made. 
How the non-motivated child Is 
helped; how aides, parents, and 
other volunteers feel about their 
place in the school; opportunities - 
that are presented for staff to 
exchange ideas, visit each other, 
and communicate. 

Documents : Any records of 'student - 
awards, assemblies, tutor lists, 
classroom standards for behavior. 
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How are the varying developmental stages of 
students acknowl^||ed and accounted for within 
the environment? - 

11-25 
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9 primary source of information : ' Verifying sources of information : 

Area of Investigation . school/classroom observaCijn' * Interview/documents 

The nature of the Is the physical setting . conductive to each Explore "Wit h teachers, aides, sup- 
physical environment student's full partlctptlon In school life? port staff, administrators, and* 
K ' , • % district personnel : How decisions 
• * How do students and adults share responsibility about the physical plant are made, 
for their environment (bulletin boards, and who Is involved; staff involved' 
, * ' displays, cleanliness of .roomw and school In maintaining the physical envi- 
» / , * grounds; etc.)? ronment school. 



1 



Is the school anr at^factlve , clean, and safe 
place for students to be? 



II r 26 
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CPPOR UNITES FCR 'WTOVXHT THE €NVIRO*CNT *IN WHICH LEADING TAKES PLACE 



The-etatements listed below indicate actions which my .have been or 
need to be taken to -ippr.oye' the effect iveneu of your program. The 
specific opportunities ielected by> the reviewers reflect their 
tnderst ending of ydk program and their best suggestions for rfwt your 
neat steps might be to rake your program mdre effect ive for students, 



c^^fs 



staff and dfflfts at the school. The SSC/SAC/BAC along with othpr staff 
and parents should review these suggestions, determine their potential 
effectiveness for program ipprovement, and then decide how your ongoing 
planning, translating and evaluation procedures will be used to 
incorporate them into your program. 



a. Manage the instruct tonal program in* ways which encourage students 
ta 

-e Be self ^directing r tf 

. o Be self -checking and self-correcting 
6 Make independent -choices * 
o Be successful as a learner 

b. Build into the daily schedule activities which encourage students to 
extend J; heir capabilities and pursue their interests. 



Extend opportunities for students to perticlpete in a wide variety 
I of academic and cultural activities end s in activities which promote 
personal and social porth. 



d. Adro* ledge stuctont effty| 
* personal, and social areas.*' 



and accomplishments in academic r 



e. Arrange opportunities for students to wor^c together in activities 
rftlch ere goal -oriented and #tid) allow them to feel pride and 
satisfaction in accomplishing thecals., 

Model respect for others, irtfcrstendlnq, and appreciation for ifjdi- 
vldutl dif fineness among students and staff. 



^ g. Greets ohysical arrangements that reduce visual or sound 
distractions and provide an appropriate environment for learning. 

+ h. Organize Joint student; staff, parent, end district efforts to, 

\ provide/Wlntain^sare, clean, and attractive environment. 

i. Set and apply schoolwide standards fbr ^u<t»nt behavior. 

| J. Oraanla the classroom environment to facilitate * int elation of 

• Individuals with Exceptional needs. * 



Selected Opportunities for Improving 



: \ 



k. Provide guidance for students «ho feel anxious, confused, mi sunder^ 
tood, or directionless. . % ' 

h-Sponsor extracurricular * activities sudi as student government, 
clubs, sjiorts, end sq forth. 
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V. 



J 



THE EFFECT OF EXCESS-COST SERVICE ON 



This criterion focuses on the extent to which 
the supplementary instructional and instructional 
support services (Title I/SCE) received by each 
educationally disadvantaged student work together with 
the regular program in order to accelerate 'student 
progress and provide for continuous progress. ' 

In Judging the effect of excess-cost services for , 
students identified as Title/SCE participants, fftrst 
identify the students which are receiving these ser- 
vices. Then look specifically at - those services 
supported by Title I and/or S<3 funds which are in 
addition to the regular district program for all stu> 
dents. The services may be provided by people employed 
to provide supplementary services j( e.g. , instructional 
aidf, resource teacher, counselor or psychologist, 
•nurse's ; aide, community aide), k or Materials and 
equipment purchased to .provide alternative, learnlpg 
opportunities for the identified students,^oc both. 
Review the budget page of the school plan to %»t "ermine 



. 1 



EDUCATIC^ 



• Y DISADVANTAGED STUDENTS 



iryWafc ar* being purchased^and the ajreas of 0 the , 
Jirf which funds are being expended; then look" 



what se 
"program 

for excess-cos t^services in those areas. 

To what extent do the* excess-cost services work 
together with the bas£ program, ill order to acce}ex*ate 
student progtess and provide for continuous progress t 
Observe the, educationally disadvantaged* students, at 
jfdtk; talk to them about their work; loolj at their past 
work. talk to the clas.sroom teacher, th# aide, the' 
specialist 3taf£ about the excess cos* services. How 
do these setViees fit 'in wi^th the regular program of 
instruction? «How Jib tfiose working with the student 
communicate witji each oth£r? How well *re the services 
working for the student? ,4 m 

• . - « 

. Remember that the purpose of excess-cost services 
is to supplement the* regular program to cpmpeqsate for 
the participants' low achievement levels by accelerat- 
ing their progress. 
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CRITERIA FOR JUDGING QUALITY 
•THE IJFFECT OF EXCESS-COST SERVICES ON EDUCATIONALLY DISADVANTAGED STUDENTS 



This criterion] focuses on the extent to which supplementary instruc- 
tion and instructlpnal support (Title I/SCE) received by* eac* 
educationally di#tfvantaged, student work together with the regular 
prognp In order to accelerate stddfent progress and provicfe for 
pontinuous progress. « / . 



In applying this criterion consider: (1) All excess cost services 
provided by Title I/SCE funds through all catfegjries of expe-xli tares, 
includi-ng efntralized and contracted services and capital outlay, 
and*(2) All identified educationally disadvantaged s tilde nts, including 
those in bilingual education programs funded through Title I/SCE* 



The' excess cost services ^.received by the The excess cost 
- - students are' not based on student needs. The 
• * regular instruct kpal program and instruc- 
% tloAal excess cPSr services are separate and 
poqr^ % cooitfinated, providing little 
cpr*i^uity of Uearnidf' for students. , Student 
• work 9^o«s 'little <6j no acceleration lin 
student, achievement . Assessments of wflat 
' itudenf* have learned' and have >pt to learn- 
' |te rift: used for.Joio^ planning by the tegular " 
■ *M»$Gcra ' Readier artf excess cgst^services 
.^^f,_L#§s!bns consist pri«aril/^5f skill 
*~ ,dr]>l wit* l^ited,ort»rtuMties^ for applying 
v .t|w''3Nilw/tide<^tions for students are low. 
% % Emm c&t ^n^ructiontf support services \ 
* , rfa^had* Ut,tl4 or no^effec* in mtetinfr the 
.healthy and.- gjmoi' needs/ of stJtfents or 
v providifB iiv&tvfe* training^ for* ktaf f in „ 
Meeting' special needs\f pe'^icW^ Parens 
of participating 4 Sfotopcr?*** little 
tax* ledge' of 't**ir student's' schorl pro-am 
and arfenof involved in it. * 



services received by the . 
students are largely based on student needs 
'althou^> assessment of student needs is rather 
global and/or not t up-to-date; they are 
supplemental to the regular _ program and the 
articulation between* the regular classroom / 
• program and the instructional excess cost 
s^Tyiges provides continuity of learning for 
many', but not all, students?- Student work 
shows that thefc is steady progress in student 
acMevOTeot . Expectations for students held 
by teaching staff generally are challenging. 
.The excess cost instructional support have 
been effective in meeting the health and 
" guiftence needs of students and in providing 
in-service training for staff in meeting 
special needs of participants. Parents of 
participating* students afe informed *out 
their •student's school program, althou^i few 
are di redt ly invo lved in the student ' s 
learning. \ 



The' excess cost sejviqcs received by the 
students match student need?5 the services are 
supplemental td and fully integrated with the 
students' regular classroom program, resulting 
in a program of continuous- progress for the. 
students. • Student work shows that stutJent 
progress is. accelerating. The expectations 
axJ standards for student performance held by 
both the teaming staff and the students are* 
high. Excess cost instructional support is 
effective in meeting health and guicbnce needs 
of students and providing in-service training 
for 'Staff in meeting—special - needs -of 
participants, -Parents of ^participating 
students are toowledgedble *>out their 
student's 'school program and are directly 
involved in his or her learning. 



< 
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GSftE FOR COLLE 



INFORMATION ABOUT EXCESS-COST SERVICES 



Areq of Investigation 

Provision of excess <v 
cost services within \ 
regular Instructional 
settings 



m Primary source of Information : 
observation of Instructional settings 



by an aide? 





interviews/documents 




Explore 


* 

with teachers, 


aides 9 


support 


staff, MdmlnjMI 


:rator8, 


parents 


and district ^ 


staff: 



Provision of excess 
cost services In special 
Instructional settings 



What materials are being used? Do th*y provld^ The base district program for all 
alternative learning opportunities for the students. The services provided to 
students? Are they appropriate to the needs of Title I/SCE students over and above 
the students? v the base program. . How It can be 

shown that those serylc«8~ truly 
— . supplement district ^erfortm. How 

*deci slons were pade regarftng how 
When services for Title I/SCE students a?e Title I/SCE monies would be 
provided out of the regular, classroom In a 
laboratory or resource or media center or 
^special class, who determines what those 
services will be and when they .frill be 
•provided? 



What period of time do the students spend in .the 
laboratory, -center or special class, per ^ek 
and how are they scheduled? 



*How does the regular teacher know what 
specialist teacher - is providing? 



the 




90 



fiow do the regular teacher and the specialist 
^teacher work together to provide* for continuous 
^progress for the students? * 

Are the regular teachers and the specialist 
teacher convinced that the ^students are making 
' extra progress because of the extra services and 
what is the basis of this conviction?* 

6 

Is there criteria for exiting from the special 
instructional settings? 

11-30 



expended. Who was involved.' .How 
people know whether, the selected 
personnel r materials, programs, 
processes are effective In 
accelerating, the growth of- the 
students. How the various services 
(district, Title % I/SCE, SIP, 
speech; guidance, etc.) are lnte~ 
grated to provide maximum benefit- 
to students. How all those pho 
work with an individual Title I/SCE 
student share information so there 
is a unified approach. f 



yi 



Area of Investigation 

Provision of support 
services 



7 



Primary source of information ; 



observation 



What effects have the. planned staff development 
■'activities had In preparing staff to me$t the 
Special needs of the identified students? 

How have the -parents education activities and 
parent Involvement in the classroom and school 
progrn Increased parents 9 understanding and 
support of their children's program? 

How have health and guidance services been used 
to meet the special* needs of Title I/SCE 
students? What effect have those services had? 

V 

How have the Title I/SCE resources of the 
district been used to support the school 
program? 



Verifying sources of Information; 
Interviews/documents r 

Explore with Title I/SCE aide, 
resource teacher; Th$, roles of the 
Title I/SCE aide and resource 
teacher. With whom they work. If 
they are multifunded (SIP/TiHe I, 
for example), how time accounting 
is managed, How they know that 
what they do with students makes a 
difference in their learning. Whert 
students get special help outside 
of the base program, wlio decides . 
what they will learn* 

Documents; Title i/SCE student lists; 
budget allocations and printout Sf 
time account sheets; records of stu- 
dent progress; lesson plans; aide/ 
teacher? classroom/support personnel s 
communications; standardized test 
data; list <5f personnel by r funding • 
sburce 
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t OPPORTUNITIES FOR ItfTOVTNG THE EXCESS-COST SERVICES FOR EDUCATIONALLY DISADVANT/UED STUDENTS 



The statements listed below indicate actions rfiich may have been or 
need to be t*en to improve the. effectiveness of your program. The 
specific opportunities selected by the reviewers reflect their 
understanding of your program and their best suggestions for what your 
next steps mi^t be to mafce yoi* program more effective for students, 



staff, and others at the school. The SSC/SAC/BAC, along with other 
staff arid parents, should review these suggestions, detftimine their 
potential effectiveness for program improvement, and then decide how' 
your ongoing planning, translating, and evaluation procedures will be 
used to incorporate them into ypur program. 



i 



a. Provide staff development sq that etch fttaff mentoer who works with 
" the educationally disadvantaged student^ knows: 

- What the planned excess-cost services are, how the services fit 
in with the regular program, and that the services are intended 
to accomplish. - 

- How to work together with excess-cost services and/or regular pro- 
gran staff to provide a continuous, process program for stuctents 

- Mow to adapt his or her teaching skills to the specific needs of 
* . the educationally disadvantaged students at the school 

b. Allocate time for frequent Joint planning by the classroom teacher 
and excess-coat services instructional staff. 

c. Examine excess-cost services and the regular classroom instructional 
. program to determine whether each one compliments and reinforces the 
' student ' learning occurring in the other, and make modifications 

i*ere necessary to provide a more fully integrated, continuous 
progress instructional prbgram for participating students. 

d. Verify that performance expectations for participating students are 
comparti>le to expectations for other students and are challenging 
enou?i to ac tele fate achievement. 

e. Analyze the Quality of the, excess-cost services in terms of how and 
tohat students are learning and applicable opportunities for 

* improving the jrogf am. 

f. Analyze the quality of parent participation and education, excess* 
cpst services for health and guidance and staff development, and 
*>plic*>le opportunities for improving. y 

g. Provide LEP studbnts with excess-coat services ' appropriate for 
students learning English-as-a -second- language jnd receiving 
instruction in their primary language. 

E/S 



Select^Jpport unities for improvlnp 



95 



ma 



94 



11-32 



v - 



-THE EFFECT OF BILINGUAL SERVICES QN LIMITED-ENGLISH- PROFICIENT STUDENTS 



Jhls criterion focuses on the extent .to which the 
l4*t%e<H|ngllsh-prof icient students are acquiring the ' 
OTwipuage skills needed for academic achfevement In an 
earvjronment which promote*/ the students 9 self-respect and. 

cp>4» cultural understandings. m 

*- W * 

' ' £flee this, section to judge the effect of the bilingual 
settees, oil LEf* sludent* In schools that have 21 or more 
UfP students being served through: 

• » ■ 'I * . \ 

• \A« (a), (•>)» or (c) (innovative) program at any 

grade levels K-6 ^ 

• A <d) program at any grade level 7-12 • N 

• J A*lt*J or (f) individual learning program, K-12 v 

* When applying this criterion to a school program, # 
consider all LEP students receiving .bilingual services « 
* through the planned program. y 

A The procedures for reviewing t>i lingual progra* j/sk|£- 
vJcef are identical to the procedures outlined prevloysljr' 
for^isiudents In any program: (1) Observe student^ and % . 
staJff during' instruction, (2) review records of student * 
performance and/or program planning and operation, -and 
(3} Interview students, parents, and staff. m 



Find out what students are doing, how they. feel 
about their program and their progress, if they blow 
wt^t to do next or how to "find what they do not khow.V 

Observe the students at work; Jflnd out how their 
day Is organized; look at their current acid past work;* 
observe what materials are being used and what materials 
are available. Watch how they relate with . other 
students an staff. Notice how, when, and with whom they 
use their primary language. Talk to the students about 
what they are doing. l Ta ^^ t0 th* teacher and aide about 
how they work with the students; how they know what 
students already know, are .skilled at,,' and need to learn 
in both languages of the bilingual program; how they 
feel about program operation and pupil progress in the 
primary language and English. Find out what their 
expectations are for the LEP pupils In content instruc- 
tion and in Engllsh-as-a-setond-language, Explore with 
them the ideas of identification, diagnosis,, reclassifi- 
cation, and language designation for basic skills or 
Content instruction. In (a), (b), or (c) programs, 
observe the fluent-English-proficient and/or English- 
only participants as' well. Find out how they are 
learning English, and how they participate in activities 
involving the primary language and/or culture of ttie-LEP 
pupils. 



\ 
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CRITERIA FOR QUALITY 
THE FFlECT CF BILINGUAL SERVICES ON LWITB)-ENQ.ISH^ROFICIEMT STUOENTS 



This criterion -focuw on the extent to rfiict/ 
profidtnt students are acquiring the lana< 
academic achievement In en environment rtlch 
self-respect and cross cultural irkte {standing^ 



the limited-English- 
skills needed for 
promotes the students' 



L 



In applying this criterion consider the -effect *f the bilingual 
services on all UEP studwtsjin an. (a), (b) f (c) f or (f) program 0<«f) 
or a (d) «B7ot (e) program (7-12) when there are 21 or more LEP 
students. * . - 



( 



The LEP students are making limited progress 
in developing the skills of tinders tariffing, 
spacing, reading, and writing in English. 
Instruction in English-es-a-eecond* language 
tends to sporatlc and content instruction 
In English saldqn is adjusted to the students \ 
ability to a comprehend. The students' language 
strengths 4n English and the primary language 
are assessed infrequently* Student work 
indicates that the ma^rity of LEP students 
are msking limited progress in quiring 
skills and knowledge 'in other areas of the 
curriculun. The' npterlalv- being used 
frequently are Inappropriate to the language 
skills and learning needs of the sVlfcQt/ 
Cross cultural activities are few and limijtafr 
in^ scope. The ifr students* tend to isolate 
themselves from other students on c*pua. 



Th* [£P students are inking reason* la 
pro<je?s .in developing English language skills 
of Understanding, sp^bti" 9 ' reading, and. 
writing; their work also Indicates steedy 
progress . in the acquisition of skills and 
knowledge in other areas of the ci*rlcuk*i« 
The instructional activities in rfiich many 
students are] engaged, as well as the materials 
being used, match , t^e 'assessment of .the 
.stj«|nts' ' language % strengths; .for other 
however, the instructional 
Les .and materials are not fully 
lie ' with ✓ their current , language 
(knerally, stents feel positive 
themselves and tnfij second language 
3, arid they are developing knowledge 
understanding of the cultures of the 
various languages at the school. 




Jpye LEP students are making . exceptional 
progress in developing the skills of under- 
standing, spe*ing, reading, and writing in 
Engli*. Their work indicates that they also 
are making repid progress in the acquisition 
of skills and knowledge in Other areas of the 
curriculJ*»\^ Instruction is^^ntinubusly 
adapted tot each aidant's abUtty to coapre^ 
hand. It is evldi^ that each student's pro- 
gram is desired in response to both initial 
V^d ongoing asaaasment jof his or her language' 
.strengths in English and, the primary language. 
The adults working with the studejps use a 

^ variety of mejfe rials and teaching strategies 
to provide successful" learning experiences for 

• each student in both English and the studmt's 
primary language. Students are enthusiast fe^ 
rtwut learning in a second language and the* 
primary language (s) of the students is used 
freely in thrf school by students as well as 
by adults'. * Students^ attitudes ' toward 
themselves are positive; they are proud of 
tteir cultural „ heritage -an* participate 
readily , in cross .cultural activities with 
other students end the adults at the school. . 



GUIDE FOR COLLECTING INFORMATION ABO Iff THE EFFECT OF BILINGUAL SERVICES ON LEP STUDENTS 



Area of Investigation 



Primary Source of Information 
OMervatlon 



Verifying Sources of Information 
" lntcrvjEewe/dpcuments \ 



Student progress 



Explore with' bilingual, staff: How the 
Initial assessment was conducted and 
Jiy whom 9 what was Included; how the 
Information vaa shared with others; 
how ongoing assessment is conducted 
and how frequently; how the data are 
used In the design ot the student's 
program. 



How- wtfs the Initial MHiiient of 'the 
language strengths ef the. LEP and FEP 
student (In an (a), '(b)» # (c) class- 
rooms) conducted? Who did It? 

Did the assessment inc^ide understand- 
ing, speaking, reading and writing la 
both English and the. .student's primary 
language? 

How was the assessment data used in 

the design of the student's - 
Instructional program? 

How frequently are assessments made of Documents : Assessment Instruments, 
the student's language strengths? How student records, lesson plans. 

Is It done? By whom? ! " 

How are assessment data used to adjust ' 
the amount of Instruction the LEP 
student receives In English? 



r 

What,curricular areas are being taught 
In the student 'a primary language? 
What In English? How does this match 
(he studant'a diagnostic assessment? 

Does the language used In Instruction 
correspond to the student's language 
strengths? 

What are the students learning In each 
language? What kind of academic 
progress are tJ^ey making? 
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Explore with bilingual staff s What 
clirricular areas are Included In the 
student r s program in English and the 
primary language; how the languages 
are used by the adults in the class* 
room; who decides what materials, will 
be used and what basic and supple- 
mentary materials ard supplied by the 
district. 
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Area of Investigation - ■ 
Tba student*' Instructional progri 



f 
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ERIC 



Ptlmary source of Information s 
" A Observation 



How are the two languages used in 
managing the .classroom, giving direc- 
tions to students, answering student 
questions? ^ 



During the 
Languages 



ruction how are the two 



How are the 
bilingual stiff 



language skills of the 
being used? 



What Is the Ireadth and variety of the 



materials 

language? 



14 



How Is the 
apd primary, 
' LEP students 



Jn what wayi #re the materials the 
Student Is ui Ing match to his or her 
language strengths? 



What kinds 
.are use* 
Inst met loi 
tlve, gr 



Verifying Sources of Information 

Interviews/documents *■ 

Explore with bilingual staff : How the 
student's schedule Is determined and 
how students are 'grouped for 
instruction; what kinds of teaching 
methodologies are used; the criteria 
for reading. In a second language; the 
reclassification criteria standards 
find procedures 9 how the staff 
participates in reclassification*, and 
how many students have been reclassi- 
fied. 



the students primary 



mef scheduled for English' 
inguage instruction? For 



i 



Documents: 



How is the! student f a Instructional 
program 'adjusted to his or her 
increasing J development of English 
language skill!? 



Student' records, leason plans, aides 
schedule, criteria for reading 
placement, and reclassification. 



instructional techniques 
In kecond language 
? - f unctlonal/ c ommunlca- 
t-baeed, both? 

tent instruction in English 



to* 



the student's level of #> 

f 



How Is cc 
adapted 

comprehension? By * teachjer language, 
body - /language, gestures, by 
appropriate ^reading materials, use of 
concrete materials or referents? 
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Area of Investigation 



Primary source^ of Information : Verifying Sources of Information : 

, Observation ^ Interview/documents ~ 

, Are LEP students grouped , for ESL and' , 1 * 

• Content Instruction in English 

according to their comprehension - 

levels? . . * 

Are the criteria for the introduction 
of reading In a second language* 

appropriate? % Are th.ey consistently v 
applied? ' 

Do the teachefs know the district's , 
reclassification criteria, standards, ^ ^ 

and procedures? 

How do the bilingual teacher and/6r 
aide work with students? 

What effect % have the planned staff 
development activities , hatf in 
increasing the bilingual education , 
1 skills of the teacher and the aide*? 

In what way have the staff development Documents : 

activities been bas^d on the staff development records, 
individual skills needed of the , 
teachers and alder? / 

How has the primary language of the , 
LEP students been used In staff 
development activities? 

How effective does staff believe the 
staff development activities have 
been? 



Certificates, waivers. 



V 
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• (PPWTINITIES FCK S IMPROVING T>€ EFFECT OF BILlN^iAL SERVICES ON LIMITED*^ ISH-PRCFICIEW STUOENTS 



* The stato«ots listed below indicate actions which m4y have been or 

* need to be taten to improve the effectiveness of your program. The 
specific opportunities selected by the, reviewers reflect their 
understanding of youf program and their best suggestions for rfm your 
next -steps might be to make your program more effective for students, 



staff, and others at the school. The SSC/SAC/BAC, along with* oth^r 
staff and parents, should review these suggestions, determine their 
potential effectiveness for program improvement, and then decide how 
your ongoing planning, translating, and evaluation procedures will be 
used to incorporate thefn into your program. 



a. Assess 00 an ongoing basis each student's skills in canprehension, 



nw33 aii v , _ _ 1 comprehension, > 

speaking^ wading.* and writing in English and" his or her primary / 
language and modify his or her program to utilize those Hrengths. 

b. Er»ure that materials in the primary language of the lEP student are 
availible for at least every curricular area tau^t in the student s. 
primary language. ' 

c. Provide in the primary language of the LEP student, instruct ion. for 
the FEP/English-only stu&njts In (a), (b), (c) classroons and 
promote language acquisition rather than learning. ^ 

d. Ensure that the criteria for introduction of reading in the second 

* language include both 'minimal English proficiency and primary 
language levels and. are consistenly usfcfi. 

e. Ensure that the reclassification criteria are consistently applied. 

f. Analyze the manner in which languages are used for instruction.- 

,^g. Exmine the pytfnt » n *h^* l^sar* . In English are comprehensible 

'to LEP^students and modify instruction accordingly. 

h. Encourlfca-use of thfe student's primary language outside the 
classroom and in extracurricular ^activities. ^ 

i. Utilize the culture of the LEP students and cultural resources of 
the LEP cammnity in multicultural and cross cultural activities. 

J. Hake «signments of bilingual &ta£f so as to make optimum use qf 
their language strengths. 

k. Provi(>e staff development for the monolingual English staff in E9. 
instruction. 

1. Assess the language skills of the bilingual aides/ * 

m.' Provide stjrff development in the language skills necessary to 
instruct in and model bdth languages of the bilingual program. 

n. Provide staff development for teachers and aides to increase their 
skills in bilingual teaching methodologies. 

0. Provida encounwanent and support for teadiers working toward a 

* ^ilincual certificate. * 

* E/S 
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Selected Opportunities for Improving 



J 
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THE EFFECT OF INSTRUCTION AND SERVICES QN THE. STUDENT WITH EXCEPTIONAL NEEDS 



J 



Tills .criterion focuses on the extent to which 
Instruction and services provided/ each student with 
exceptional needs are enabling him or hec to make 
stefdy progress toward achievement *of his or her 
educat ion a nd so c 1 al go a 1 a with opt taunt pa r t Ijc i- 

pation in th* total School, program. ^ 

** * * . 

I To understand how instruct imn an# services 
impact on the student with exceptional n^eds, y<?u t 
as a reviewer, m^^ld concentrate primarily on the 
total program of » .sample r of ' individual students. 
You vili-have tp synthesize information learned from 
both regular and special education ; per;sonnel t as 
well as observations of the student in regular Imd , 
special -settings. 4 This synthesis / will Involve the 
entire rSv lew team-." 

/ After developing a good understanding of. the 
total program of* a sample of student a, focus on how* 
services and J^ftruct ion from* various sources inter- 
met to format he .whole. \ 

' In order to unde^ifcfcand how the schoql supports 
the student^ witti -exceptional needs, the reviewer 
should talk to the people who arr In^olnad in the 
referral-assessment-lEP process. In most cases this 
wlljrinclurfe the resource** peel alist and* the princi- 
pal, who. can identify assessment and IEP members. 

Examining the proceaa will give you as reviewer 
e basic understanding ojf the flow of ^ events that 
reaulta In the delivery of services* to the student. 
Try to relate what you have^aeen in various settings 
to the Information you received from adulta who are 
involved in the program.. You should emphasize 
relating the information from adulta to the program 
that is received by the student. 
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Question the school staff, district support, 
„ staff, the. Special Education Service Region (SESR) 
, support staff, the parents and student* in order to 
* develop a. complete picture of the special education 
students in 4ll possible 'settings: the regular 
classroom, the /school grounds, the cafeteria, as 
well as the sett ingjv where special, education 
. services are delivered. 

* ^ Once, the process of How, and wtyat services arm 
delivered ^to . the student^ is understood, you can 
» determine: , A - 

»* f m How the special education Inatructlon and 
v services- and the regular program Interrelate 
( *e How adulta cooperate In coordinating these aer- 
vices and programs 
e How the time aitocatibiuf and schedules are 
^ determined */ * ' * 

e How the staff la^aigrarted in Integrating 
special educatiortv^J^ents into the classroom/ 
school environment 
. * , , • ■ i - * 

b Determine the quality (not quantity of the 

contribution made by special education services, and 
t^he quality of the regular education contribution 
(Including compensatory < education, bilingual 
"services, Mlller-IJnMh, etc. y along with the base 
program).* Since this crltej^'n calla for Judging 
the- effect of instruction orflKudents, it resembles^. 
v and parallels the other instruction*" criteria, ) 
especially "How "Students . are Learning"^ an^Thf^ 
Environment' In wich Learning Takes PJape M ^rhie 
criterion differs primarily in its focus on special 
education students. Much of what Is <|one for the 
"How" and Environment** will be useful for applying 
this criterion* * * 



4 
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^CRITERIA FOR JUDGING QUALITY- 
THE EFFECT OF INSTRUCTION fiND SERVICES ON THE STUHENTS WITH EXCEPTIONAL FCEDS 



,Thi$ criterion focuses on the extent to which the full curricula and 
other instructional and related services received by, the *tu*nt. will 
result in his ot her acquisition of the skills and knowledge necessary 
for success in later grade levels. 



>ly this criterion when special education services are offered. 
:onsider each student on an IEP including those in special day 

classes. 



The activities in which' the student with 
exceptional needs* is engaged" seldan match his 
or her indjviduel^hjeeds, strengths, or ways of 
learning. His or her activities are incon- 
sistent with the. IEP goals, and objectives and 
student wort indicates yttle . progress in 
meeting these goals. The student's total 
education progran is fr^nented; there .Is 
little or no ccnmnicatiop or collaboration 
anong the stVf who* work with the studtent. 
Services are duplicated or conflict with other 
lrvtructional programs; * frequently disrupting 
the student's school day and he qy she is 
making little progress in the regular ct*ri- 
ctilun. The student is rarely included even 
when appropriate, when decisions Ire made 
affecting his or. her educational and social, 
growth. The student and others lack Irowledgs 
S>f or have inappropriate attitude toward the 
handicapping, condition and* staff, (*her stu- 
dents, parent s r and community manners are 
reludart to 'atfcept, and to extend oppor- 
tunities for participation to students with 
special needs. ^ 



The student with except ional needs is 
participating in activities which ^nerally 
r«tch hif or her individual needs, strengths 
bnd ways of learning. The activities are- 
consistent jwith'the goals and objectives of 
the IEP and student work indicates progress in 
meeting those goals. While; there «e 
opportuiities for the student to participate 
in the total school progrin, sometimes the 
environment and/or the instructional materials.* 
vrt activities are not of sufficient range or 
flexibility to allow full participation. The 
student's instructional program and related 
services are being coordinated by the special 
education and other instructional staff and he 
or she is making progress in the regular 
curriculun. 'The student participates, as 
appropriate, in decisions abcyt his or her 
education. He or she demonstrates knowledge 
Aout thp handicapping condition and has an 
accepting attitude' toward self and others. 



Hi 



The student with exceptional nee^j is engaged 
in activities that are-speciTically matched to • 
his or her indivi&al needs, strengths, and 
ways of learning. Student work, indicates 
steady progress toward achievement of the 
academic, social, vocational, and c*her goals 
and objectives as outlined in the KP and in ^ 
the regular curriculum Materials, activities, 
arid environment of the class/ichool are 
adapted to en*le optbiun participation in the 
total school program. Oonwmication, colla- 
boration and mutual support . between jpedal. 
education and other instructional staff about 
the student's instructional programs ensure 
consistent reinforcement and follow-Mp' of 
services provided the student, whether in the . 
regular classrocm or special education set- 
ting. The student U invoked to tjbe maxima 
extent *>propriate in decisions which affect 
his or her educet ional and social powtft* He 
or she has sufficient knowledge of and an 
accepting attitude toward his or her handi- 
cwinflf condition, as have staff, dhe* 
students, parents, and ccrem/iity members, and 
is well accepted by his or her peers^ 




to* 
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GUIDE FOR COLLECTING INFORMATION ABOUT INSTRuVflOT A»D SERVICES 
FOR S TO DENTS WITH EXCEPTIONAL NEEDS 



At— of investigation 

Act ivl tits in which 
the student is 
participating 



- Primary Source gf Information: 
. observation " " 

To what extant la each atodent developing 
akills in Identified areas of need? 

Are atudenta involved In activities which build 
on existing individual strengths? 

Row do* activities witch identified student 
needs? 

Are Act ivl ties dea Igned to provide s tudent 
success? 

Do activities provide sufficient challenge to 
each a tudent? Are expectations appropriate to 
individual skills and abilities? 

Is instruction varied to Include individual $ 
small group and Urge group settings (aa 
appropriate to the instructional activity and 
student rtesda)? 

Are activities design*)! and materials organised 
and located to increase the student's ability 
to work Independently** In small groups? In 
large groups? ~ J 

Are actlvltlea;dealgned to match tfte student's 
learning style? 



Verifying sources of Information: 
"~ * interviews/documents 

i * > 

Explore with : Students 9 regular 
v classroom teachers, resource 
specialists, special education 
parents, specialists providing 
designated services, special class 
teachers, district curriculum 
specialist, program specialist, 
aldea, principals, any persona 
designated "by the principal or 
resource specialists aa being 
Involved in providing aervlcea to 
students. 



Documents ; IEPs* teacher 1 a plan 
books, assessment results, records 
of DIS specialists, student 
progress reports, home/school 
communication about student work> 
curriculum material*, proficiency 
standards, evaluation* 



Student progress 



How is ' student progress monitored and 
evaluated? Is' progress In the regular program 
monitored 1ft a similar manner? 
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J 



\ 



Area of Investigation 



Adaptations for an 
integrated educational 
program 

, • / 
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Primary source of Information : 
Observation 

What are the procedures fo% making changes to 
>the student'A^prograoi? Are they known to. all 
who work with the. student ?♦ How flexible are 
these procedures? 

How are students Involved In monitoring their 
own progffss? 

How Is the IEP used as a tool to manage and. 
measure student progress? 

Are new IEP goals and objectives written as 
8<*>n as stated objectives are achieved? • .4 

If stated objectives are not achieved as 
expected, what alternative methods are 
. Initiated? * 

Are the .student's specific identified needs' 
addressed by the currlcular Ire^s being 
covered? « 

Does t^e curriculum also Include those areas 
* addressed * for regular students as much as 
appropriate, e.g., literature, multicultural, 
etc.? ' , 

How does the curriculum accommodate differing 
learning rates and styles? 

t 

How has the mode ''of presentation fdr the 
curriculum been adapted as needed to meet the 
special needs . 9 of each student;/ i.e., 
transcribed, Brail led, taped, etc.? Have the 
materials been adapted accordingly? 

Is, supplementary explanation or interpretation 
mr curriculum provided for students? 
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Verifying sources of Information s 
~ Interviews/documents " 



4 



/ 
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r~ j Primary source of Information; - * . ■ . ^ Verifying sources of Information; 

Area %t Investigation observation - + \ • a ~* inter views /documents 



i 



\ Are teaching methods and strategies adjusted In 

* ' consideration of tjie student's hatffi capping 

condition? ; 

Are adjustments made in curriculum-, materials , 
environment, and teaching strategies, according 
to student progress? * * 

*• > * •„ * 
^ How are materials , medi^, and equipment usage 

* ' 3 t ^ In all settings adapted % to the' needs of the 

student ; to the curriculum being taught , and to 
, 4he goals and fbj-eptives in the IBfP? x 

How are .the timer allotments and schedules 
geared to the needs of the s tudent ? How 
flexible are the school 



r 



-services to the needs 



chool and the special 
of individual students? 



What provisions for counseling .are included In 
the IEP? Are^fiey being Implemented? How Is 
meat ion kl, counseiyig being provided? ' Is Ait 
related to the careeg/vocatlopal assessment? 

Least restrictive * Are Instruction and services provided in, the 

environment least"* restrictive environment? ' 
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What,, assistance Is provided; , if needed, to- 
facilitate* participation In regular program and 
.activities, i.e. , Interpreter for deaf, aide 
for physically handicapped, etc.? 

11-43 



What pppertunltfes does the student have t^ ? 
learn, and practice skills and behaviors which, 
will Increase integration opportunities? 

What is the range of opportunities considered 

for a student to . participate in 'regular ✓ 
programs sjk! ^tlvltles? 
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JUrea 6f Investigation 



Attitudes of staff and 
students 



1 
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Prl awry source of Information; 
1 observation 



Is the space where services are provided 
appropriate and sufficient for the number of 
students? 



^Where are special education services provided 
at t\ie •schpol? Does their location promote the 
integratf^oft special /education students Into 
regular schjHf actlvltl/es? 

For students in spicljd day classes, i*o 
decides where the studitoats will be placed 
durli« Integration Into tWFregijlar program? 

How are students with exceptional needs treated 
on the school -grounds at recess? Before and 
after school? 
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"Verifying sources of Information; 
"~ interview/documents ' 



Are there specific activities tq enhance the 
positive attitude of staff, parents, and 
students toward students with* special needs? 

Are all students considered when planning _ 
school activities? { 

In - * what ways do students participate in 
decisions made which affect their Educational 
and social growth (attend IEP meetings, 
parent-teacher conferences, ertc.)? 

How acceptii^ of. special education students are 
the regular teaching staff, supt>ort- staff? 
Students? 

What are special education students called as a 
group? * ' 

Does the classroom environment include'' space 
for individual, small group, and large group 
activities? 



\ 
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Area of Investigation 

« 

Coordination of 
services . 



Primary source of Information: 
* observation 

v What kinds of reinforcement and follow-up 
special Instruction and services does the 
student receive In all' other settings, i.e., 
language art s/ speech therapy, reading/ phonics , 
resource specialist , physical education/ 
mobility Instruction? Are they Consistent? 



) 



Verifying sources of Information: 
interviews/documents ! " 



^ 



How frequently * does the student x receive 
frequent feedback from those persons directly 
involved? 

What provisions' have been made for ongoing ^ 
staff development activities* in special educa- * 
tlon for regular staff, administrators, special 
education staff/ support staff, parents? 

How are regular staff . provided with ongoing 
assistance with integrating t and coordinating 
the program* of ~ students with exceptional needs 
in their classroom? Is this assistance 
ongoing? " 

How do the regular and special education staff 
communicate and < coordinate the student's pro* . 
gram (written progress updates, frequent meet- 
ings, scheduled consultation periods, etc.)? 

What klnd^ of follow-up to services received in 
the regular classroom or the special education 
setting is provided for the student? 
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OPPORTUNITIES FOR IlifWlVING TH^EFPECT OF INSTRUCTION ANO SERVICES ON STUOENTS WITH EXCEPTIONAL NEEfiS 



Th*-stat0i»nts listed below indicate actibns «hich may have been or 
need to be t*en to Improve the effectiveness of your ^program. The 
specific opportunities selected -by the reviewers reflect their 
i^derstarvJinfl of your program and their best suggestions for *iat your 
next st*>s m#it be to make your progrsn more effective for. students, 

4 • 

a. PMn and provide-sfcquential activities for the achievement of goals 
and objectives in the student's ISP. 

b. Develop ongoing systtm to fjonitor st6dent progress in achieving 
goals and objectives in the IEP as well in the regular program as 
indicated. 

c. Provide activities which challenge' the student and afford an 
adequate rate of success. * , 

d. Expend; the range of resources, •materials, and enviSQrtments *ich 
are avfciUble to students with exceptional needs. 

/ -\ _ • ■ • 

e. -iGa&b curricula, teaching methods, and learning environments to meet 

individual student needs. % , - 

f. Est*>lish a system,, formal or informal; for sharing information 
about the student between all persons work with him or her. * 

g. Involve each student as. appropriate in decision-making regarding his 
or. her. educational and social yowth. 

h. Provide except tonal students with appropriate information regarding 
their individual disabilities as well, as abilities. 

i. Involve staff, parents, and regular student! in staff development 
and Other activities tfiich promote understanding and acceptance of 
students- with exceptional njeeds* 

v J. Provide staff .development and ongoing support for regular classroom 
teaohers in integrating and coordinating the program of the stuctents 
P l with exceptional needs in their .classrooms. 

.E/S 
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. staff and others at the school. The SSC/SAC/BAC along with c* her staff 
and parents should review these suggestions, determine their potential 
effectiveness for program improvement, and then decide how your ongoing 
planning, translating, and evaluation procedures will be used to 
incorporate them into your program; 



Selected Opportunities for Improving 
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THE EFFECT OF THE STUDENT'S 

r 



While developing an understanding of what s tu- 
dent's learn within each subject area, the reviewers 
should also be figuring out how the currlculusi cornea 
together as a whole for the Individual student. Judg^r 
ments about this overall .curriculum are based ^ 
primarily on three understandings: 

1. What the district and school have defined 
(or failed to define) as the core of skills, 
knowledge, and values students are expected 
to learn 

2. The curriculum actually experienced by the 
selected sample of students , including past 
and planned studies 

3. 'The relationship between 1 and 2 

To understand what the district and school expect 
students to learn, reviewers should rely primarily on 
interviews". Be aljrt to changes in expectations or 
loss of clarity from the initial definition of skills, 
knowledge, and values to the expectations expressed in 
course work assignments *trf the feedback given to 
students about their learnf^g (or lack of It). «Ask 
about graduation and proficiency requirements. Ask 
about differentiated proficiency standards for special 
education students. 
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PROGRAM ON THE "STUDENT 



To understand the curriculum actually experienced 
by each student in the sample, reviewers should rely 
primarily on student and * teacher interviews • and 
student work, including course readings. To see how 
a student gets enrojled in his or her particular 
course of study, find out both where the student gets 
advice on courses and who decides what courses the 
student will take. Consider past and planned studies 
over the full span of years In secondary school. Talk 
to guidance personnel as well as teachers and peers. 
Do students and teachers understand what sMclflc 
skills, values, and knowledge are expected for: pro- 
ficiency standards, graduation requirements, _pn trance 
to cortege, occupational preparation, adult partici- 
pation in society, and personal goals? Are the 
expected learnings comprehensive? Does the instruc- 
tion provide for learning what is expected? Is the 
student taught to extend and apply whit Is learned? 
Taught how to put.it together? • 

The curriculum as it is experienced by special 
education students may be quite different from the 
curriculum presented to other students. The IEPs for 
special education students should provide a basis for . 
evaluating the effect of instruction on each student. 
Because standards and expectations may be different, 
some of the questions may not apply. " * 
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CRITERIA FOR JUDGING QUALITY 
THE EFFECT GF THE STUDENT'S TOTAL PROW AM ON T>€ STUDENT 4 



which the student's 
will result in the 



The focus this criterion is on the extent to 

full curriculum and Other and related* services - - - 

acquisition of the skills, knowledge, and values necessary for success 
in an occupation anchor further education. 



In wlyfna this criterion considers (1) the total curriculum received 1 
by the student and (2) all special instructional and related services. 



The curriculum of the school is limited. In 
scope; expectation* for what is to be learned 
ere unclear or urfoovn. In course work the 
student is learning a fragmented and random 
assortment of skills, knowledge and values 
which offer little opportunity, tp reach his or 
her personal and vocational goals or p^fcpar^ 
for future education. Little is expected of 
the student pest mininmi proficiencies; when 
the student has difficulty in learning what is 
being taupt, there is no overall plan to 
bring him or her up to minimal proficiency. 
The schedule of special instructional (compen- 
satory, bilingual, and/or special education) 
end related services is disruptive to the 
student m) deny him or her continuity in the 
courses he or she is taking. The stu<fcnt 
V receives little, heip or m encouragement to 
become responsible for his or her learning or 
' to prepare him or her to succeed Jin a vocation 
or for further education; 



The curriculum of the school includes the 
Skilly, knowledge, and values necessary for 
the student to achieve his or her major^per- 
sonal , academic , and socl al goal s and to 
become prepared for an occupation or further 
education. Expectations for what is to be 
learneiWtave been defined, and generally the 
, student knows what he or she is expected to 
learn in the courses he or she is taking. • 
while a variety of courses is available to the 
student, problems with scheduling,' coordina- 
tion, and art ic ulat ion be tween depa rtmept s 
and/or ftck of timely guiAnce sometimes 
interfere with the student's desired course 'of 
study, resulting in difficulty in* acquiring 
new skills and knowledge -Or extending and 
applying those skills he or she has alaftady 
learned. -The special, instructional and related 
services (compensatory, bilingual and/or 
special education) received by the student 
generally are coordinated, with the student's 
total program of study. mfe student is 
involved to some extent in planning and 
evaluating his or her progress over the 
years. 



The c^riculuVof the school is of sufficient 
soe0e and rigor^for the student to attain the 
skills, knowledge, and values necessary to 
achieve his or her personal, academic, and 
social goals, and to become prepared forr an 
occupation or further education. The student 
and those who teach* and 0uicte him or her, low 
what the student is expected to learn. The 
student's progren of study 'over the 
including community-based learning and extre- 
curricular activities, will enable h> or her 
to attain these skills, knowledge, and values. 
Jhje Special instructional (compensatory educa- 
tion, bilingual and/or special education) and 
related ,sfrvlc£ received by the student 
enhance «J facilitate his or her total pro- 
gfrwn. Jhe student, In the courses he or jhe 
, hps t*tfn Jn the past, is now taking, and will 
be" taking,- is/V»allenged/ to Integrate the 
*ills, knowledge, and -valurfs already ^earned' 
and to apply them in increasingly complex 
situations requiring fresh idees and 
Judgronts. The student ,'s U\t -expectations, 
desire to -achieve, and pense of accomplish- 
ment are sustained at a high level. m 
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GUIDE FOR COLLECTING INF&RMATIQN ON THE EFFECT OF THE STUDENT'S TOTAL PROGRAM ON THE STUDENT 



Area of ^Investigation 



Definition of 
and 



skills, knowledge 
values 



Primary sourge^of Information : 
Observation" 



Is there an overall curriculum plan 
for the school? Does It Include 
clear expectations for 



common learnings every 
'expected to learn? 



a core 
student 



of 
Is 



yo -staff and students 
'these expected common 
How do staff 9 Incorporate 
overall curriculum objectives 



understand 
learnings? 
the 
Into 



defined expectations for Individual 
courses? Doe* each student receive 
instruction aimed at a given 
objective in a variety of courses? 

— Jn his or her program of study, is 
the student exposed to A coherent 
patteofr of learning experiences, or 
Is there a patchwork of learning* 
fragments? 



f Are skills, 
defined for 



kno vl edge , a nd val ues 
all stages of stqdent 
development— from minimal prof lr 
clency to the most advanced levels 

of achievement? A 

♦ 

What are the school wide expefetar 4 
tlone for workawnsMp, punctuality , * 
classroom 'behavior, etc.? .How 
clearly • ar4 - these specified to 
parents, students, staff, etc.? ^ 
What is the, evidence that they are 
reinforced ih all classes?^ 



Verifying Sources of Information : 
™ ! Interviews/documents 



Explore with _ 
familiarity with 
curriculum policies. 



teachers*' Their 



district; 



Explore with district staff : Mow 
the' curriculum policy was developed 
and implemented. Was there staff 
development? Were state curriculum, 
frameworks used? 

Explore with guidance staff .mod 
others in an advising role : How 



they use: 

knowledge, 

planning. 



the defined 
and values in 



skills, 
program 



Documents : 
documents, 
student's 



District 1 curriculum 
course offerings,, the 
individual course of 
study, texts, lessen plans, 
proflclenpy guides. 
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^ **• Area of Investigation 



Breadth of .curriculum 



♦ 




* Primary Source of Information : 
^Observation 

Does the core curriculum of common^ 
learnings include i 

NOTE : The following lists of • 

learnings are not lists of 
courses, but learnings which 
should be Integrated into a 
variety of courses in a 
variety of vays. 

Basic learning skills such as: 
writing , ' mathematics including 
problem solving, reading from reme-~ 
aial to advanced skills, speaking 
and listening, critical thinking, 
vocational/ skills, Intellectual 
curios 1 ty , independent j udgments 
aiKji reasoning , grammar 

Cultural heritage such as: litera- 
ture, art, music, drama, aesthetic 
values, foreign- language, ethnic 
studies, Intellectual history, and 
multlculutral education 

Citizenship and* societal studies 
such as: civics, democratic rights 
and responsibilities, - political 
heritage, U,S. and jporld history, 
Economics,, rurrentr affairs, and 
other social studies* 

Science such as: y basic sclmntlflt' 
methods, biology, physics^/ chem- 
' istry, earth science? physiology, 
ecology , astronomy , elect ronlcs , 
and computer science. 
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Verifying Sources of Information; 
interview s/documents 

Explore with teachers and students: 
Where the ikills, knowledge, and 
values locally defined as common 
learnings appear- in course work* 
How the content of each course was 
planned so that the appropriate 
common learnings were Included. 

• How individual educational programs 
, were developed for students with 

special needs, 

j 

Explore V^th advisors, counseling . 
and guidance personnel : How the 

• individual's program is planned to 
i ensure each student covers the full 

range of skills K values , . and 
knowledge which are appropriate.. 

Documents : The -individual course of 
study, course offerings, texts, 
v syllabus, course outlines, student 
work 




Area of Investigation 



How the curlculin Is coordinated 
and articulated among teachers 



'" r Extension, application, 
and integration 
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Primary Source of Information : 
Observation 

Is the currlculub coordinated 
between grade levels ^and depart- 
ments to enable continuous progress 
for all students? 

Do the classroom teachers ' and 
resource or specialist teachers 
work, together to ensure oontinulty 
of learning • for students? (Con- 
sider those students who leave the 
regular classroom program for spe- 
cial instruction — Title. J/SCE, LEP, 
MGM, 'special education. 

Is the student; encouraged and 
taught how to extend and apply what 
hej^r she ■ learning to hl^ or hej 
ow^pfe , present and planned? 

Are related skills, knowledge, ahd 
values being taught in different 
courses 'in a coherent sequence? 
For example, how does the math 
department coordinate with the 
cotfklng teacher in ^aching frac- 
tions and recipfes? Hov are the 
English teachers working with 
history and science teachers in 
teaching writing skills? 

How do teachers and students take 
Skills, knowledge, and values 
already learned in various courses 
and use them to solve complex prob- 
lems in new courses? For example, 
how ar* learnings from math, his- 
tory, and political science brought 
together in economics and geo- 
graphy? How are reading, critical, 
thinking , and workmanship skills 
use*} in planning and executing a 
metal ahop project? 

[II-5L 





Verifying Sources of Information : 
interviews/documents 

Explore with teachers arid support 
staff: How the records of contin- 
uous" pupil progress are designed, 
monitored , evaluated , articulated , 
and modified throughout the school; 
how information about the student 
is communicated by the support 
staff who serve him pr her. 



^Explore with* staff : How programs 
are planned across years and sub- 
jects; , what Is the form where 
teachers from various departments 
discuss course content and 
sequence; how do those who advise 
students know and use 'course con- 
tent and sequence information- in 
planning the individual student* s 
program? 

Documents : Course outlines, texts, 
student work, the individual course 
of study 
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Area of Investigation 



Instruction received and 
cqutsltlbn of skills, knowledge 
and values 



Primary Source of. Information ; 
Observation 

• Occupational preparation such as: 
career education, vocational cour- 
ses, Industrial arts, distributive 
education, business, technology, 
and workmanship. 

• Personal and social development 
such as: respect' * for self^ and 
others , self -discipline , s tudy 
habits, " leadership, cooperation 
skills, organization skills, 
emotional health Including stress 
management , family and parent Ing » 
human growt h sJfid deve lopmen t , 
nutrition, physical education, 
lifetime sports, drug abuse, health " 

How much Ins truotlonal time , In 
odaes and In homework, 1* allocated 
to the skills, knowledge , anJ 
values? For example, how much 
' writing does a particular student 
dp during the year, considering all 
courses In which he or she Is 
enrolled? Do the teachers of the 
various courses communicate about 
how much and what kind of writing 
the student Is doing? Does anyone, 
besides the student, have a fair 
notion of how much time Is 
allocated to each skill or know 
• ledge area? • 

' Across courses and years, how is 
the student's progress in acquiring 
the expected skills, knowledge, and 
values monitored? If a student Jias 
problems, what alternatives are 



Verifying Sources of Information : 
Interviews/documents 




Explore with teachers, guidance 
personnel f , others In the advising 
role, and students ! How progress 
l5 monitored; how problems are 
detected. After a problem Is 
detected, how corrective steps are 
Initiated. Are records of progress 
kept; how are they used; by whom 
and how often? 

Documents : Progress records, 

cumulative folders, student courses 
of study, student work, alternative 
offerings / < 
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Area of Investigation 



Primary Scfutce of Information : 
* Observation 

em pi dyed to ensure meeting expected 
standards? Do teacherg .from 
various departments cooperate in 
teaching' a given skill or yalue, 
e^g. 9 problem solving?" Do all- 
teachers of students receiving 
ispecial services ' understand the 
\planned programs for ' these 
students? 



Verifying Sources of Information : 
interviews/documents 



Rigor in elective courses* 



Is - there rigor in the course work 
which is appropriate to the subject 
area and, ^ff£ne same time, produc- 
tive in making progress toward per- 
gonal and school goals? 





Are courses designed to 
sfriident* s 



meet the 
interests or strengths 
Tor example, are 
students in * a ^tllm^appreclatlon 
class required to write film' criti- 
cism, to inalyfce and appreciate 
formal dramatic \ structure, j|rfge 




characterizations! discuss 
moral and life pioSlems prefWfed 
by the films, etc., as weii* as 
enjoying the film? Are students In 
craft courses taught standards of 
workddnship? . Do * the ^ physical 
education teachers cqrVect spelling 
errors as, well as ^gach principles 
of team work? A * 




Do samples of student work reveal a 
standattiyj)! quality wotkmanshfp? r 
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CPPWTINITES FOR IMPROVING THE EFFECT OF THE STUDENT'S TOTAL PROW AM ON THE STUDENT 



The statements .listed below indicate actions which may have been ot 
need to be taken to improve the effectiveness of your program. The 
specific opportunities selected by the reviewers reflect their 
understanding of your program and their best suggestions for w^at your 
next steps might be to make your program more effective for students, 



staff, and. others at the school. The SSC/SAC/BAC,. along with other 
staff and parents, should review these suggestions, determine their 
potential effectiveness for program improvement, and then decide how* 
your ongoing planning, translating and .evaluation procedures will be 
used to incorporate them into your program. 



138 



a. Extend the atudsot's curriculum so that eac* student has opportuni- 
ties to develop skills and knowledge in the fine arts, social, 
natural, and physical sciences, and other curricular areas as well 
as in the basic skills of language, reading, and mathematics. • 

t b. Explore ways of providing more time for^students to develop skills 
1 and knowledge in other arenas of the curriculum as wel^as in the 
basic skills. . ■ 

c. Provide opportunities for students to apply basic skills in other 
curricular -areas and .to integrate other curricular learning into the 
acquisition of basic skills. 

d* Provide > variety of opportunities for students to* pursue their 
educational interests. 



e. 



Prioritize the sped a} services provided stutfcnts, focusing on their 
most urgent needs. 



f. 



Reschedule the times *he^tudents are .pulled out of the regular 
classroan so that they have the. opportunity to participate in the 
full range of curricular activities. 

g. Coordinate £he students* instructional program so that: 

- The instruction they receive while out of the classroom builds 
* on, extends, and/or reinforces classroom instruction. 

' • c -mt ' \ t» ' * 

- They have the opportunity to acquire any necessary skills or 
knowledge that they may^have missed while out of- the classroom. 

h. Develop or refine methods of ccironication between the classroom, 
teacher, and specialist staff so that eacfc is kept current with the 
students* progress in,bofch* settings. 

i. Allocate tW for plassroan teachers and specialists to plan the 
students* instructional activities together. , 

J. Explore ways of mdfcivating each stutfcnt to become responsible for 
Kis or her own learning and work to prepare him or her to function 
successfully in later grade levels. 



Selected Opportunities for Improving 
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C: THE EFFECT OP SUPPORT OH INSTRUCTION 



The information collected In the first section 
of this handbook, "The Effect of Instruction on 
Students >" become* \ the base for further 
Investigation Into this section, "The Effect of 
Support on Instruction." What the reviewer has 
learned about, how and what student/ learn, the 
effect of Title I/SCE and services fo/ LEP students, 
and the learning environment, are palmary places In 
the process of gathering Information In • orde^" to 
judge the quality and compliance/ of a school 
program. In looking at the support areas of staff 
development, parent and Community participation, 
guidance and health services, and district support, 
reviewers begin t* develop an understanding ef how 
the instructional program came to be the way It- is. 
and why. 

The process of synthesizing information begins 
in a reViewaesoon_^ 
fit t£gecbet into larger segm^ts. 

For Example: The reviewers observed students 
using s manipulative materials during mathematics 
instruction in several of the classrooms visited. 
Interviews with staff and a review of the staff 
development records indicate that In-service train- 
ing sessions on the use of math manlpulatlves had 
been held and that staff felt they were worthwhile. 

* Thus, the reviewers in the example cited were 
abl* not only to begin to understand wh^ mathematics 
Instruction was the way it was, but also were able 
to observe the effects of the staff development 
sessions as students were using manlpulatlves In 
several classrooms. However, the "whole" of staff 
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development had not emerged. Remaining questions 
Included: How were decisions about staff developr 
merit priorities made? Who had participated in the 
sessions? The partial effect of Jtaff development 
was observed and now served to ^direct further 
inquiry. It Is important to note that only when the 
remaining questions have been answered and the 
"whole** of staff development Is known can reviewers 
judge the effectiveness* of staff 'development. 

- The review process works not only from the 
student through Instruction and support. to plannlig, 
but also In reveree order. 

For Example: The ( reviewers learned from the 
school plan that the staff would have in-service 
training on how to establish mathematics learning 
centers. They further learned that all staff had 
participated In the in-service training sessions 
that were designed to help teachers establish and 
mcrrrttar learning centers where students could 
practice the mathematics 'skills being learned and to 
apply "mastered" skills. However, no "learning 
centers were observed la the classroom*, and the 
teachers stated that the in-service training 
sessions were very interesting but that they had hot 
yet had time to Implement the suggestions. 

Thus, the effect on students of this segment of 
staff development Was not observable, 

It Is critical- to remember that evaluation of 
support activities is directed to the effect of 
support activities on instruction, not parent 
Involvement, for example,, as an. Isolated element of 
the school program, nor" the evaluation of district- 
level support as something apart from whit Is 
happening. In the instruction of students. District 
support activities may appear to be of high quality, 
but if they are not appropriate to the school 
program, they are not effectively supporting ^the 
instruction of students. 



THE EFFECT OF JUPPQRT ON 



This criterion focuses on how effective staff 
development activities have been In Increasing the 
skills and knowledge needed by the teachers, aide?, 
other staff and volunteers to Implement the planned 
program. 

The effect -of staff development on the Instruc- 
tional program can be viewed from two perspectives: 

t One, analyze completed staff development activ- 
ities, and find what effects or traces there 
are on the Instructional program. Determine 
whft kinds of staff development have been 
offered and for whom. Review the^ school plan, 
identifying staff development assessed needs 
and planned activities. Talk to the principal, 
the program coordinator, district" personnel, 
and res pons Itile SESR program specialist or 
whoever la responsible for staif development to 
find out what has been offered, why It was 
offered, who participated, Jjov It was pre- 
sented, and by whom. Verify and, add to this 
Information by observing staff at work with the 
students and questioning them about their par- 
ticipation In staff development activities. 
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INSTRUCTION: STAFF DEVELOPMENT 



• Two, trace staff development through instruc-' 
tlon by establishing the types df Instructional 
programs thgt are In existence and determine m 
what staff development has been offered to sup- 
port the program. For example: as a reviewer 
you learn (hat a new writing program has been 
Implemented. Determine what staff development 
was provided' to support the Implementation of 
the writing program. 

Remember that the review of staff development 
Is focused on the effect of the staff development 
x activities. While knowledge of the kinds or number 
of activities engaged In by staff members and volun- 
teers Is Important for developing an understanding 
of what has happened In staff develppment and how it 
might be made more effective, you will be Judging 
the effect of the staff development activities — iron 
whatever source or whatever 'nature—on the Instruc- 
tion of students, and instructional support and 
Improvement process activities. 

NOTE : All adults who work with students should' 
participate in staff development: teachers, aides, 
specialists, resource personnel, principals and 
other administrators, parents, and other volunteers. 

% 
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CRITERIA FOR JJOGING QUALITY 
THE EFFECT OF STAFF DEVELOPMENT ON IhCTRUCUON 



This criterion focuses on how effective staff development activities 
have teen in increasing the skills and knowledge needed by the 
teachers, aides, other staff and volunteers to implement an 
irfctructional program responsive to stydfent and program ne^rls. 



In ^plying this criterion consider the effect of staff development on 
the instructional program including services for students with -jjMial 
needs and abilitites (LEP, Title f/SCE, special education, an^gmed 
and talented). Include all staff development activities (group and irtr 
dividual) provided for all staff and volunteers involved in the program 
regardless of the source of funding utilized to provide such activi- 
ties; i.e., district, SESR, county, SIP, Title I/SCE, and so forth. 



Staff development activities have been 
Ifcdted and have little or no relationship to 
the planned program. They have had little or 
no effect in increasing the skills and 
knowledge .of the adults. There 4s misunder- 
standing or lack, of understanding of the 
intent of tfe school's planned program. Staff 
mentors are unclear about their individual 
responsibilities and ,have ^ed little or no 
understanding about what others are v doing or 
how what they do fits with what others do. 



E/S 



Staff development activities are increasing 
the skills and knowledge necessary for imp 1 ce- 
menting the program planned to meet student 
ard program needs. The act ivi ties ^ire addres- 
sing, on a priority basis, those skills and 
too* ledge most needed to implement the planned 
program. Staff development activities are 
helping to increase the skills and <taowledge 
needed by each person to carry out his or her 
responsibilities; most members of the instruc- 
tional staff are applying the skills and Know- 
ledges addressed in the staff deveiopmerfc 
activities. Staff generally understand the 
intent of the school's planned program. Host 
staff members understand their individual 
responsibilities for implementing the program 
and how what they do fits with what others do. 



Staff development ^activities have been highly 
effective* in enabling the adults to implement 
an instructional program responsive to student 
and program needs. The adult knowledge} and 
skills needed to implement the planned program 
havf hrm irtpr*t f W In steff- 
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development activities. Each adult has learned 
' whatever he or she needed to learn to carry 
out his or her part of* the planned program. 
Staff_members understand the school's planned 
program, their individual responsibilities for 
implementing it and how what they do fits with 
what others do. There is obviote commitment 
/ to continued participation in staff develop- 
ment activities and to applying the acquired 
toowledge and skills. 

HIGH „ 



Teachers 
Aides 

Other Stem 
Volunteers" 



I I 



I I 



I I 



l~J 



I I 



I I 
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•Other staff includes the principal, othe^adninistrators, and support, staff (certified and classified) who are directly involved in 
imp lamenting the program. 

•**)iurtqers include parents, comiunity members, cross-aged tutors, and student teachers. ^ 



Area of Investigation 

Increased ski 11*8 and 
knowledge 



Primary source of Information: 
interview 

— * 

What changes/ref Inenents . have staff members 
made In working .with students as a result of* 
,the staff development activities? 

How are staff supported In Implementing newly 
learned techniques, materials, and/or 
strategies? 

How are certified staff prepared to work within 
the cultural differences of students? Are 
-frhey — well-prepared to m eet ■ thfc peed g—of-"t£?- - 
students', gifted . students, students with 
exceptional needs, or educationally disadvan- 
taged students? 

Are they prepared to guide the personal and 
social development of each student as well as 
to Instruct In currlculuV"areas? 

Haw do" the parents, community members and 
other volunteers work with students? Are 
their skills adequate? Is this consistent 

throughout the classrooms? J 

• * 

How do Instructional aides reinforce skills and 
assist students with learning activities? 

What kinds of in-service training have certi- 
fied staff aftd others been given to enable them 
to identify behaviors which may require 
referrals.? / 



Verifying sources of Information: 
observation/documents ~ 

Qbservatlon ; 

What effects of staff development 
ef forts are visible in the cla£fe§r 
rooqj; do adults seem to have # 
sense of direction and progress In 
staff development; do adults seem 
to ha^f developed cooperative 
relationships designed 'to carry out 
the school's planned program? 



Documents : Review records of 
staff, staff development activi- 
ties, council meetings; needs 
assessment information; cxamiunica- 
tlons to parents; evaluations of 
staff development by staff; evalu- 
ations of staff development imple- 
mentation in the classroom; SESR 
comprehensive plan and/or PL 94-142 
opportunities for staff develop- 
ment. What kind of match exists 
between th^^eeds of the students 
and staff^k expressed in the 
school plan and the staff develop- 
ment activities? Compare the needs* 
expressed in the plan with what Is 
being offered. 

it 
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What in-service activities and ongoing assis- 
tance are provided regular classroom teachers 
to meet tfhe needs of students receiving special 
services? 
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Area of Investigation 

Relationship to planned 
program 



r 
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Primary source of Information: 
Interview 

Hoy vere aides, council members, parents, 
community members, and other volunteers 
involved inr designing their staff development? 

What roles does the principal play in staff 
development? The district,?. 

What is the overall plan for ptaff development 
activities? (Consider frequency, time lines, 
sequencing.) How does it relate to the needs 
oflfetaff to carry our the planned program? 

What opportunities are there for st^f f to 
discuss_p»rether what they are trying to do and 
the effect of what they are trying to do? 

What kinds of opportunities are there for joint 
teacher-aide in-service training? For joint 
special education and regular education staff 
development activities? 

What are the procedures for articulation and 
integration of skills and knowledge acquired in 
staff development? 

Do staff members and volunteers think that 
staff development activities have been useful? 

How are council/committee members prepared to 
fulfill their responsibilities? How effective* 
do they, think their preparation has teen? 

Do the support staff members (librarian, nurse, 
speech and language specialists, and psycholo- 
gist/counselor, program specialist, etc.) 
understand their roles in implementing the 
planned programs as described in school plan? 
How helpful have staff development activities 
been to them? 

11-59 



Verifying sources of Information: 
observation/documents 
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^ Area of /Investigation 



develi 




Ihg and* 
Jug staff 
activities 




J* 



interview ,. 



How has the school used its resources Tor staff 
development? .Are teachers and o£her staff 
members encourage*! to lead staff development 
sessions? I 

What * external resources has the school used 
(e.g. , teacher centers, professional develop- 
ment centers , county , district , and SESR 
resources, an4 the special educat ion service 
region)? ^ 

flow "has tfie school utilized its community/ 
parent resources? How- effectively do staff i&\ 
these resources have been used? 

f - . 0 . 

How do staff members and administrative 

personnel evaluate the effect of the staff 

development 'activities? , ^ 

How are staff developmeht evaluation results^ 
used? " . • . . * > 't 



Verifying sources of Information : 
, ~~ observation/documents ] 



4> 
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CPPORTINITIES FOR IMPROVING STAFF CEVELCF*€NT 



The statements listed below ifdicate actions which may have been or 
need to be taken to improve the effectiveness. of your program. The 
specific . opportunities selected by the reviewers reflect their 
understanding of your program and their best suggestions for Wiat your 
next steps jnl$>t be to make your program more effective for students, 



a. Identify the skills *id knowledge needed to cartv out the planned 
program, including -services for studfents with special needs^ 

b. Assess- existing skills and *>owled$e of s£aff, parents, ccrnmcnity 
mwtoers «J btier volunteers working in the program through ongoing 
evaluation. 

* 

c. p Deteimine the differences' between existing and necessary skills and 

knowledge, 

d. Set priorities for group and individual staff development activities 

e. Base ►activities on the differences between existing and necessary 
skills and Knowledge of paints, canmrity members, and <*ha*. 

f . Involve the staff, parents, community members, and others fll deter- 
mining what their staff development activities should include and 
how they would be presented and by whom. 

g. Individualize activities to meet the varying needs of the staff. 

h. Allocate sufficient time for staff development activities. 

i. Utilize staff skills and talients for providing staff development 
. activities. 

• * » ~- 

1. Use school, district, Program Improvement for Improving- School 
Consortia, SELPA, coimnity, and dther resources for staff 
development activities. ' 

k. inlorporate into staff development activities ways of confirming 
that the adults have acquired and are using skills and taow ledge » 
presented. i% 



staff, and others at the school). s The SSC/SAC/BAC, along with other 
staff and parents, should review these suggestions, deteimine their 
potential effectiveness for program improvement, and then decide how 
your ongoing planning, translating, and evaluation procedures will be 
used to incorporate them into your program. ' 

Selected Opportunities for Improving 



E/S 
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" THE EFFECT OF PARENT AND COMMUNITY PARTICIPATION ON INSTRUCTION 



Parent and community participation is a broad 
category that Includes: 

- jArent Involvement in the classrooms and the total 
school program * » 

- keeping pa-rent* informed about their children's 
program and the school program, including the array 
of services available to students With special 
needs 

- preparing parents and community to assist in the 
school program x 

- providing opportunities for parents and other - 
community members to explore their Interests in 
areas related to panning, implementation, and 

the school 'program * 



evaluat 



at^orr of 



In* addition, the parents of children receiving 
special services are provided with information which 
is pertinent to thj/ needs of their child/children. For 
example , parents #of . students "Vith -/exceptional needs 
are Informed or appropriate SESR and coMunity 
resources. *f ~ 

<* • ■ 

In evaluating how parent and community partici- 
pation affect the instructional program, find out how 
the school staff informs parents about the program and 
the day-to-day activities of ,4 he students, how parents 
are directly Involved in their children's educational 
experiences, and to what extent parents and other com- 
munity representatives have been involved in ongoing 
planning and evaluation* 1 „ j. # . a . f ^ 
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CRITERIA FOR JUDGING QUALITY 
1>€ EFFECT OF PARENT AM) C04*NITY PARTICIPATION 



Th* focus of this criterion is on the extent to which ^ parents and Jn applying this criterion* consider the effect of parent and community 
other ccmmunity miters are kxjwledgeile ixxit and support the school Twrticipation on instruction, check the box below thjt description, 
program as well as the student's full participation in school life. 

For Judgments of quality between descriptions, check an appropriate 
intermediate box. 



There is evidence that few parents and 
cowm/iity matters have understanding of or 
commitment to the sctiooi program, their 
students' program, or the school plan and 
improvement efforts. Few are involved in 
planning, Implementation, or evaluation 
activities. Few parents and community members , 
are aware of what they could-^do personally to 
support implementation of the planned program, 
including IEPs and BILPs. Involvement of 
parents and St her members of tJw^sommunity is 
infrequent and sporadic and provides little 
support to the instructional program or .to 
efforts to implement the planned program. 
There is evidence that school communications 
have had little, if any, impact on enabling 
parents ind community members to understand 
their students' school program and to support 
them in their participation in school life. 
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There is evidence that most parents and 
community raefiters actively involved with the 
school program understand and support it. 



Parents show enthusiam for and commitment to 
±he program and improvement efforts; They are 
knot 



om ledge able about the school plan and, when 
They are aware of the school plan and, when^appropriate, the SESR Comprehensive Plan, and 
*)propriate, the SESR Comprehensive Plan, and know where and how they can assist in imple- 



major thrusts for the year. Parents and 
conmunity menters not actively involved, have 
same understanding of the program and are- 
aware of their children's day-to-day activi- 
ties, including those specified in IEPs, 



menting the planned program. Parents and 
other community members provided significant 
source of support in implementing* the prolan 
e.g., throu^ workstudy, apprenticeships, ike. 
Parent and others community members provide 



BILPs, and. other, individualized learning ^significant support also to evaluating the 



plans, but they have limited knowledge, of the 
school plan or of specific efforts to improve 
the program; they are generally nbt awaire of 
what they 'could do personally to support 
implementation of the planned program. There 
is ^evidence tbat parent and community activi-^ 
ties both on- campus and off campus have ena- 
bled 'some parents and other community memtfers 
to participate in the planning, implementa- 
tion-, and evaluation of the program and to 
support more fully their students' 
participation in school life. 



^ I 



planned program. Parents* taiowledge of the 
instructional program, including individual- 
ized learning plan*, IEPs, BILPs, and the 
manner in which students are learning enabled 
the parents to support more fully „ their 
students' full participation in school life. 
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GUIDE TO COLLECTING INFORMATION ABOUT PARENT AND COMMUNITY PARTICIPATION 



Area of Investigation 



\ 



Primary Source of Informatlqfc ; I 
Observation ~ } 



Verifying Sources of Information : 
▼ interviews/documents ] 



Communication to parents 
and community 



What avenues of coamiunicatlon are! 
jised to keep the parents and commu- 
nity aware of the school program? 
Do the various means of communica- 
tion present a complete description 
of the program. Including all ser- 
vices available to students with 
special needs? How understandable 
.are the communications to parents 
aftd the community? Are the stan- 
dard communications written In 
plain, understandable language? Are 
non-English-s peaking y parents 

contacted with materials In their 
language? What responsibility does 
the district assume for communica- 
ting with parents? Is there a 
regular newsletter, fadlo, or TV 
program about the school's Improve- 
ment efforts? How well Informed 
are parents about day-to-day acti- 
vities of their duftfrien? Do 
parents understand the district 
prof Iclency standards and their 
purpose? Do they understand 
requirements for graduation and 
thelc son f s or daughter's standing? 
Do parents of *H6peclal education 
students understand the proficiency 
standards set * for their children 
and how these standards compare tt 
the standards for otheir students? 



Look for evidence of parent, 
c^tarenclng In your interview with* 
t^^ners, guidance personnel, 
aides, librarians , principal , and 
others* 



Examine evidence In files of news- 
letters, notes home, grade report- 
ing, systems, radio-TV scripts and 
schedules; bulletins, back-foy 
school night, guidance nights, 
neighborhood meeting schedules, and 
other methods of communicating with 
the parents and community. 



J 



Awareness of student activities 
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How do teachers report student 
progress? Are there periodic' 
parent-teacher conferences? Are 
there special Conferences^ when 
unique sltuatlons'exlst? 
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Area of Investigation 



Involvement In the 
Instructional program 



Primary Source of Information ! 
Observation 



Verifying Sources of Information ; 
" Intervlsws/doQuments 



Bqu are parents Involved in plan- 
ning and supporting students* 
educational programs? Jtov are par- 
ents of special education students 
1 n vo 1 ved In plann 1 ng s t ude nt s 1 
IEPs? * 



Do parents understand the Jbomework 
policy? What has been, done to help 
parentM In the form of classes , 
-newsletters, etc.? Are they 
expected to assist in carrying it 
out? Do they assist? * Do they feel 
the school depends on them to 
assist? 

What . are the methods used to 
Involve parents and the community 
in the Instructional program?; Who 
is responsible? Is the program 
effective? 



Hov are parents and coom unity rep- 
resentatives used as Instructors or 
tutors? Special presentors? Do 
they prepare materials? Do they 
serve as special aides? 

»■ 

Hov are^ volunteers active * In 
recruiting others to .participate? 
Are there sufficient volunteers to, 
have alternates in SSC, SAC, PTA, 
patent clubs (special Interest)? 

Are parents v and community represen- 
tatives yell briefed and trained If 
necessary to carry out the assigned 
tasEs? Are briefing and training 
programs planned, scheduled, eval- 
uated? Do parents and community 
have and opportunity to help plan 
the briefings and training? 



Discuss With parents, parent 
coordinator, principal, community 
participants. 

Observe programs supported * by 
parent and community participation. 
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Check staff develop*^ schedules, 
budgets docuaentstlpn. 
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Area of Investigation 
Instructional Activities 



Primary Source of Information : 

Ob servation * 

Have parents and community repre- 
sentatives been significantly 
Involved in the Instructional pro- 
gram? Has this Involvement been a 
deliberate part of the planning? 
Were parents and community Included 
In that planning? Do students ' 
leave school for any of the 
Instruction? Are their community- - 
based learning expe riences In 
addition to work study programs? 
Are commun 1 1 y-ba sed prog rams 
available to all students Includ- 
ing , when appropriate, > those 
receiving special services? Are 
students, staff, and community all 
Included In evaluation and modifi- 
cation? Are the community-based 
experiences related to the skills 
and concepts taught as part of the 
school program? 

Are there efforts to extend the 
community-based experiences by 
Involving more representatives fromn 
business and Industry with the ' 
school program? 



Verifying Sources of Information : 
inter views/documents 



Investigate work study program, 
special programs, e.g.' , cpmmunity- 
Uased education. Interview 
instructors , students , administra- 
tors. Review documentation. 
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* . CPPORTUNITK^S FQP IMPROVING PARENT AND COWINITY PANf IQIPATION ^ ^ " ' €fc 

The ^tateroots listed below indicate actions which may have been >r staff'and others at the school, fhe SSC/SAC/BAC along with other staf^ 
need to be taken to improve the effectiveness of your program. The and parents should review these suggest ions , determine their potential 

specific cpportunities selected by the s reviewers reflect their - effectiveness for program improvement, and then decide tow your ongoing 
understanding of your prdgran and their best suggestions for what your planning, translating and evaluation procures will be used to 
next steps might be to make' your pr<%ram more effective for students, incorporate them 1 into your program. # 



Selected Opportunities for Improving 

a. Provide encouragement for paapents and ^ther conncnity ^members to ^\ -~ 
participate inSthe schodl program; involve parents *f individuals^ 

with exceptional 'needsjirv planning, ancf reviewing IEPs. 

b. Sustain ] invoI9fement of parents and ether caimtnity mentors by 



providing for their interests and concerns. p * "^^^v 

c. Identify *id use talents, interests, and knowledge of parents and . a **'\ o>v 
other comnity mentors in the instructional and school .activities. # - 

9 P ^ 

d. Provide two^ay heme-school c amp icat ions regarding the student's * • - " J \^ 
d&y-to-day activities and the school program. , w ~* * 0 • 

e. Provide home-school commu>icAtion in the langua^e(s)- of the limited- 
arid non-English-speaking parents. 

f. Ptovide opportunities for parents and other cormcnity mentors to ^ 
express interests and needs for activities and to be involved in ' * 
planning them. s * 

g. Provide opportunities^ for ccnminity and business, leaders ^ to 

participate in the development of off-campOs learning experiences'. r . 



104 



h.'Encourage parent participation in support groups for parents > of % ^ 

students receiving special services (e.g., CAC, CAG, BAC, SAC). • 1 D 0. 



* S 



THE 'EFFECT OF GUIDANCE ON STUDENTS 



The focus of this criterion is on "the extent to 
which guidance services provided the student - are 
assisting him or her to function success fiJWy lny<? 
school. *h 

* * * • * * 

As used Wre A the term guidance refers to all 
activities t formal and Informal , that provide adVlce to 
students about their persdnal, social, educational, and 
career concerns. This advice ^may be* provided by 
teachers, administrators , peer" advisors, parent or 
community volunteers* 

ytfC assessing the effect' of guidance on students, 
determine how students* personal; educational, and, 
social needs are assessed; how 'the assessment infor- 
mation is used by teachers, guidance specialists/- and 
other advisors in creating and conducting instructional 
programs m fpr* students; what kinds of, follow-up proce- 
dures are being»used; and how the school £nd classroom 
curriculum, -organization, and environment have « rfee« 




modified to accommmodate the personal; educational, 
and social needs cTf each student. » 

In finding but how the needs of the students are 
considered In the development of courses, extracurric- 
ular activities, etc., and delivery of guidance : and 
Instruction t usf the , information collected while 
observing in ttie classrooms fend •othec v aceas etf the 
school. Be 8ure( to include^ data from the school and 
classroom curriculum as well as organization \jmd 
environment. "Combine that data with that from needs 
Expressed in the *plan &nd other information provided 
by ttfe. staff. If a^l appear6* % ta^M^worklng well for 
the students, vertfy .the data^kyr talking to selected 
student? and strfff. If l£ appears that personal, 
educational, and social" needs of all students are riot 
being jaet, determine what has, been excluded in plan- 
ning or translating the. plan Into action. Interview 
the classroom teachers ,* the special* \education per- 
sonnel, .the support staff, and' the principal And/or 
other administrators to learn, more about how effective 
• guidance services are. ^ 



/ 
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CRITERIA FOR JUDQiNG QUALITY 
THE EFFECT OF GUIDANCE ON STUOENTS 



The focus of this criterion is on how effective guidance services are. 
in assisting student's in couis* selection and in providing advice on 
personal, social, career, and educational goals. 



Apply this criterion to judge the quaLhy of the- program in terms of 
the effect of guidance students. • 



IBS 



There is evidence that most students receive 
little or no assistance with personal, social, 
career, and educational concerns. Primary 
responsibility for the development of a stu- 
dent's course of study rests with the student 
and his or her parents. Few students have 
well defined personal,] career, and educational 
goals. Few students understand how their cur- 
rent course of study relates to their 'goals, 
strengths, and needs « and to past and futuxe 
courses of study. The parents of most stu- 
dents are infoiwied of the student's progress 
only through written reports and ha^ little 
personal Contact with the school. Students 
rarely turn to staff mentoers at the school for 
personal, social, career, or educational 
advice. Such advice is normally avail* la to 
students only once or twice a year unless the 
student seeks it out. Wherv a student seeks 
advice, he or she usually mu&t wait several 
h*ys before talking with a sfaff member who 
can provide advice. There appears to be no 
formal policy for referral and assessment of 
student with learning or ertotional problems, 
or, if therfe is.\one, few staff mentoers, 
parents, or students are aware of it. Students 
with personal or social problens often are not 
identified tntil the problems become serious. 



There is evi$nce that the student is planning 
for the future in teims of forming personal, 
career, and academic goals, and the relation- 
ship between the student's program and the 
aoMev#nent of these goals is generally clear 
to the student. Most of the students,' includ- 
ing those with special needs, t£P, specitl 
education, Title I/SCE, gifted and talented, 
have an assigned s£aff member from whan they 
can get timely advice and students general^ 
use this resource and find advisors- generallj 
.Available and having needed information at XX 
time and place convenient to the stuc^mt. 
Students with ^educational, social, or personal 
problems receive |elp if they request it or 
those problems becane se r ious . Adv ice 
career and educational goals i$ available/ 
request or througt^c lasses designed for tn 
purpose. The parents of most students 
generally infoimed of the* students 1 progress 
on a regular basis through written reports and 
personal ^contacts with the school. ' Most 
students are familiar with how the school 
operates (e.g., scheduling, registering for 
classes, availability of learning 'options, 
rules, etc.). 



There is evidence that students hold high 
expectations for themselves, have a realistic. 
Dicture of their personal strengths and intel- * 
lectual potential, and generally either know 
what they want out of school and what 'to do 
after high school or are comfortable with 
their progress , defining their personal 
career, and educational gc^ls. Students are 
enrolled In courses consistent with their 
goals, strengths, and needs. Advice on per- 
sonal, social, career, and educational con- 
terns is available to students at times and 
places most* convenient to the student. For 
each student there is ^ staff mentoer at the- 
school who is^ personally familiar with the 
student's goals, strengths, needs, and educa- 
tional program and who regularly - reviews the 
student's academic progress and personal and. 
social growth. This staff member regularly C 
* and/ frequently discusses the student's aca- 
demic progress and personal and social growth 
with the student and with the student 'sr teach- 
ers and parents when necessary. Students with 
special needs or potentially serious problerte 
are identified early and receive skilled help 
before they become critical. Students are^ 
familiar with how the school operates (e.g., ^69 
scheduling, registering for classes, availabi- 
lity of learning options, rules, etc.) 

/ 
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GUIDE FOR COLLECTING INFORMATION ABOUT GUIDANCE 



Area 



of Invest^ 



at Ion 



Row guidance needs are assessed 



Primary Source of Information : 
Observatio n 

How are personal, educational, an<J 
social needs of students identl- 
f led? Does the school have a 
written, comprehensive plan for 
guidance based upon Identified 
student needs? How timely are the 
assessment procedures? Do the 
assessment procedures do more than 
the minimum required by law? If 
80 1 are they ^for all students or 
selected students? 



Verifying Sources of Information : 
Interviews/documents 

Observe classrooms; Interview 
teachers, counselors, advfjors, 
psychologists, school nurse, 
special education teacher, resource 
specialists, program specialists, 
etc., and students. Review selec- 
ted guidance files; review communi- 
cations to parents, students, 
teachers, and others 



Do students know to whom to go for 
advice on - educational, personal, 
and social concerns? Are advisors 
familiar with their advisees 9 
needs? . A 

Are advisors able to give ^useful 
advice In all areas? If, not, do 
they know when, how, and to whom, 
to make referrals? 



How assessment Information la 
used by teachers 
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Who Is responsible for monitoring 
Individual student f s progress 
toward graduation requirements? 
How Is such Information used to 
provide guidance? Are students 
aware of their standing with 
respect to graduation requirements? 
Are their parents? 

Hsve obj ect Ives and implementat Ion 
strategies for the Instructional 
program been developed based upon 
Identified student needs? 
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Area of Investigation 



Follow-up procedures 



172 



Primary Soujrce of Information : 
Observation 

x 7 

What provisions are made for help- 
ing students who are not making 
Appropriate progress toward meeting 
(graduation requirements? Are stu- 
dents, parents, advisors, and 
teachers aware of these provisions? 

How do the guidance specialists 
work with teachers to ensure that 
the learning environment supports 
the needs of students? Their 
career goals? Is there an esta- 
blished referral jnrocess for stu- 
dent* who have special needs? Is 
the process well understood by all 
personnel? What have teachers done 
to implement strategies to accommo- 
date the personal, educational, and 
social needs of students? What 
alternative programs are available? 

Vhat kinds of guidance activities 
are included .in the students 1 
curriculum? What relationship 

exists between these activities and 
the needs of students as Identified 
in 'the plan araPcne assessment of 
student need? 

How are parents informed of the 
studqnt 's personal, educational , 
and social needs? Is ' a language 
they understand used in these 
"dommunicatioQS? Are parents made 
aware of tesoufces available in the 
community , such as diagnostic or 
counseling centers? Are such 
resources used to assist students 
when needed? 

* ' 11-71 



Verifying Soufces of Information : 
interviews/documents 
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Area of Investigation 



Primary gource of Information : 
Observation 



Verifying Sources of Information 
Interviews/documents ~ 



What follow-up procedures are used 
at the -school? Do 41 visors wdrk 
with - Identified students on an 
ongoing basis In the classroom? In 
group or Individual sessions? 

Do the specialists confer together 
about Individual students? Are 
subject natter teachers Included In 
these conferences? Is the 

principal? Are the parents? 



V 
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OPPORTUNITIES FOR IMPROVJfP GUIDANCE 



The statements listed below Indicate actions which may have been or 
need to be t*en to improve the effectiveness of your program. The 
specific opportunities selected by the reviewers * reflect their 
understanding of your program and their best suggestions for what your 
next steps might be to make your program more effective for students. 



staff and others at tha^chool. The SSC/SAC/BAC along with other 
and parents should review* these suggestions, determine their potentJ 
effectiveness for prtfgram improvement, and then decide how your on 
planning, translating and evaluation procedures will be used to 
incorporate them Into your progryn. 



r st*L 
tent^K 



a. Establish a guidance program, based on Identified student needs and 
*ith expected student outcomes, which Is the responsibility of the' 
tcfcal school staff. 

b. Cstfclish or modify the guidance program to ensure that activities 
routinely reach every student without the student having to seek 
them out, 

c. Assign to every student an advi9or (instructional staff member, 
support staff mentper, parent volunteer, peer, etc.) who is familiar 
with the student's goals, strengths, ne^ds, and progress as well as 
his or her personal and social development. 

d. 4 Allocate time in eac* advisor's day for him or her to be avail^le 

at times and location convenWnt to students. 

e. Provide sufficient professional gulfcnce staff to assist with 
diagnosing and remediating severe learning, emotional, and social 
problems. 

f. Provide staff development and resources for advisors to en*>le them 
to furnish accurate information and timely advice to students 
regarding learning options, career opportunities, and other needed 
amas. 

g. P#f ide students and parents with accurate and timely Information on 
entrance requirements for post secondary education and minimum 
academic requirements for career training opportunities. 

h. Establish procedures for each advisor to revjew his or her advisee's 
progress in meeting his or her educational goals and school 
proficiency and graduation requirements. 

Establish procedures for identification and servicing students with 
personal, social, or emotional problem. 

Use follow-up studies of students to*make changes in educational 
program and to encourage stuctents to select courses which are 
challenging, yet appropriate to the student's educational goals, 
interests, needs, and ways of learning, 
k. Use parents in assessing the guidance needs of students and 
implementing fpproprlate strategies. i 
Use peei counseling as one strategy in delivering an effective 
guidance program. 

m. Provide guidance information to L£P students and ±heir parents in 

their primary language, 
n. Arrange for pupil personnel services staff to provide direct assis- 
tance to teachers in modifying the environment of instructional 
activities for individual students in light of their particular 
needs* % 
o. £st*>lish procedures and communication channels among instructional 
staff, those serving as stucfent advisors, and guidance personnel to 
create a link between the student's instructional program and 
guidance activities. 



Selected Opportunities for Improving 



i. 
J. 



1 
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THE EFFECT OF HEALTH SERVICES *' 



® The focg£ of this criterion is tfti the extent" tQ 

% s Which health "* service^ provided - the student are 

assisting him pr hfer to function successfully in* 

school. * * 

. ..... 

/ For the purposes of. an external program review, 

f the effect of health serolces *shquf<l *only be aspessed 

V when they * 'a re Included in f the School plan 4 aM 
\ assessment Halted to those areas of health In which 
9 \ consolidated application funds are expanded* 

In assessing che effect -of health activities on the 
/Instruction^^ the students, you will be, finding out' 



<y^how students' emotional, mental, *and physical Jtealth 
tfr needs are assessed, how the assessment lnfom»Pn.on Is 
used in instruction, what kinds of follow-rftp pootecjures. 



are 



being used, 



m 



and 



how 



the 



classroom . 



curriculum, organization, and environment have be$n 
accommodated to tl^ health needs .of £he students. - fi 

.In finding our how the emotional, mental, and 
physical health needs of 'the students are reflected 
in the delivery of ^instruction, use the- irf'formatlqp 
you collected while observing In the classroom and 
other areas of the school. , Be sjire to. include what 
you ^eve- -observed of the classroom curriculum as mil! 
as classroom organization and ^enviroume^t/ Combine 
£hat* information with what * you -know from needs 
expressed in the plan and other 'information provided 
-you by the staff at the school. If all appears to be 
working well for the students, verify your information, 
by talking to selected stftddlits and adults. If it 
appears* 'Ehat the emotional, menta^, and physical 
health needs of all students are no.t being met, you - 
will ne>ed to find out' what la not working. ' t 
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CQJTERIA fXJR JUDGING QUALITY 
V THE EFFECT OF HEALTH SERVICES* 



The focuS of this criterion is on how effectively the h%alth services 
provilted the student are meeting the' student's needs. 



Apply this criterion to judge the quality of the program in terms of 
the effect of the health), services- on students.' 



There is evidence that many health needs of 
students are ndt being remediated or accom- 
modated.* Assessment; of needs is limited and 
1 cursory and/or these is little follow-up/ 
C Resources available ^ the school and SESfc - 
have not beer exploreo and/or are net being 
effectively (jsed. . Specialist support staff 
prpvid* little ongoing assistance to students; 
teachers frequently receive JLittle health 
. information about' their students, pox do 'they 
receive direct assistant^ or in-service train- % 
ing to help tbem work *ittf the students with i 
health needs in their ciassrocm. There -is 
t no evidence' of -a'hiatt'h educat'ion program and/ 
^ or classes which, would enable the students to * 
tal« car*- of their own health needs. 
Generally, ^parents receive notice of their 
children's " health. t>eeds, but follow-up is 
sporadic tather than routine. 



There is evidence that most of the identified 
health needs of tne stucfents are being met, 
althoucji screening procedures in some areas > 
are not timely and/or they are li^ite<^^ 
Follow-up activities are being carried oot 
rsnediate needs- wherever possible and/Or to 
increase coqing skills of students with health 
pr^lems. Many of 'the resources of the 
school,, SESR, and community are*bein<j used for 
follow-up; some available resources are net 
being tapped and/or used as fully as possible. 
The_sf»cialist. support„stpff provide ongoing 
assistance tb students and share - important 
health information with instructional staff; 
<$he information is frequently used as. a basis 
for altering the curriculum, organization, and 

, environment for the students in order to 
accomodate their specific needs. Parents are 

^informed of their children's health needs, 'and 
the school, 3t n$eded,~ provides information 
regarding resources available for 
follow-op services. 



There is evidence that the health needs 'df the 
students are being met; the identification of - 
needs' is based on appropriate and timely 
screening of auditory, -visual, dental, phys- 
ical, and speech needs. Follow-up activities 
have been m successful in. remediating needs' 
(wherever possible) and in increasing skills 
to. cope with, health problems. All availAJe 
school, SESR, and community resources have 
been i.denti/ied and' are being effectively used / 
for, follow-up and for ♦ enhancing the health 
students; the curriculum, organization, and 
~ envlToonenT "of "t he classrooms havf been modi- \J 
fied to accommodate the specific health needs 
of the students and enables them td take care - 
of their own health needs- Specialist support 
staff provide* ongoing assistance to students , 
with - identified needs, to classroom teachers 
as they work with these* students, and to the 
students' parents. * * . 
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effect of health services should be assessed only when included 'in the school plan, and the assessment should be limited to those areas of- . 

health services in which application funds are expended. * 4 , 

* * • 
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GUIDE FOR COLLECTING INFORMATION ABOUT HEALTH SERVICES 



Area of Invesfelgat Ion 



How health need's are assessed 



) * 



# 



How health assessment information 
used by teachers 



Primary Source of Jnf ormatlon : 
Observation 

* c 

How are emotional , ^ mental , and 
physical health needs of students 
identified? What health areas are 
assessed? 

* 

Who does the assessment? A health 
specialist? The class-room teacher? ' 
Both? # 

How timely a«rq the assessment pro- 
cedures? Do the assessment proce- 
dures ^ do more than the minimum 
required by law? If so, ere they 
for all students or 'for , selected 
students? Is the extension beyond 
the legal minimum in respon&g' to 
needs expressed in the school . 
plan/SESR Comprehensive Plan for 
Special Education^ 

How are teachers informed about 
theii) student s f r health needs? How 
are Veachers • kept current with 
changing health needs? 



fylng Sources of Information ; 
interviews/documents 



.to - the school mir^e , bhe 
language f speech, and health 
speciali^ts 9 the counselor, or 
psychologist as necessary to 
develop a Aore complete picture of 
the health neeis at the school and 
the^raeans used by the staff to meet 
those needs. Talk to the classroom 
teachers ! special edifcat ion- person- 
nel, program Specialists, and the 
principal and/or other administra- 
tors 'to learn more about how effec- 
tive these support services are. 



Follow-up; procedures that are used 
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How do teachers ensure that the 
learning environment supports* the 
identified health needs of the 



students? 

4 




How are parent's, informed of thefr 
child's health 'needs? " Is , a 
language they ' understand used * in 
these coanmnicat ions? Are -parents 
de\ aware of resources available 
trte comndhlty, such as difegnos- 
tttc or coOnseliftf centers? Are 

stich resources used to remediate 
student health problems? % 

1 ' 11-76 
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Primary Source of Information : Verifying Sources of Information ; 

Observation Iritervlevg/docuaents 



What iollowrup procedures^ are used 
at trhe school? Are students vith^ 
Identified health needs rechecked? 

Do the Jtaff dealing with health 
needs confer together about 
Individual student's? Are the 
principal apd the parents Included 
In these conferences? 



_ 4: - 
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(PPORTWITIES Fl 



VI NG HEAL T^MSER VICES 



sted below indicate actions which nay .have been br staff and others at the school. The S^V&C/BAC along with other staff 
to improve the effectiveness of your program. The ' and parents should review these suggmions, detexnlne their potential 



specific opportunities' selected** by the 'reviewer* fcref-fect their effectiveness for program improvement, and then decide how vour onoolng 
* - 1 ' - and their besl-suogest ions f6r rfiat. your ^planning, translating and evaluation procecfcjres will w used to 



Understanding of your pro-am 

next steps mLjit^ to make your, program more effective for students 



incorporate them into your program. 



a. Establish and use procedures for screening, referral, and follow-up 
of student'health needs (auditory, visual, dental, physical, speech 
and language, and other health needs). 



Selected Opportunities for Improving 



Jb. Implement follow-up procedures for the purpose of remediating or 
increasing coping skills and/or accomodating needs within the 
classroom. 



*c. Provide health education instruction, includin§ **self -awareness, 
«' coping action, and decision rfaklng. 

d. Use health assessment information in the classroom to modify 
curriculum, organization, and environment to meet individual # stu<fent 
needs. . ~ / " 

^e. Ensure that parents and teachers knjr the health needs of individual 

students. ' ; . 

r 

.f. Identify and use 'avail* la state, federal, district/5E$R, and 
community resources to meet needs for health services. 

.g. Provide health assessment information to LEP students and their 
parents in their primary language. 

K Allegata district /5ES«/school resource for providing health services 
and developing curriculum. K 
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THE EFFECT OF SUPPORT ON 



Thip criterion focuses in how effectively the 
district is supporting the sfnool in* Its efforts to 
improve the planned program fcfr students. 

In reviewing district support of the school's 
improvement efforts,* examine two areas: how the 
district supports Instruction directly (e.g., 
allocation of resource specialists , development of 
proficiency standards , development of referral 
procedures, curriculum development activities) and 
how the district supports instruction indirectly 
(e.g., assistant with staff development, training 
for school site council or school adlvsory council 
members, community advisory "Committee, and other 
activities). Remember, * district support Includes 
only those efforts of personnel from the district 
office*; it does not/ Include the efforts' of * those 
personnel who work at the school ever'y day. * 

H U>ok for policies and procedures that the 
'district has established to provide leacjership to 
its school* as well as action the district has taken 
in carrying out such policies and procedures. Relate 
what has been learrted about district support to what 
has been stated In the school plan. While many of 
the policies and procedures which the cjistrict uses 
to guide schools in school improvement efforts ar^ 

' f 
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INSTRUCTION: DISTRICT SUPPORT 

4 

contained in Part I of the District Master Plan for 
> <>chool Improvement, these are not the only policies 
or the only means by which the district provides 
leadership and direction to its schools. Be alert 
to other means of communication — other policies and 
procedures set by the school board, administrative 
procedures*, and the historical "everyone Xnows 
that • . traditions. Determine what Impact such 
leadership efforts have had. Note the policies and 
procedures governing special education services # in 
the local district. 

Much of the fact-finding regarding the effect 
of district support will be covered during assess- 
ment , of the preceding support Items. Direct 
evidence wilt be gathered through InteArlews with 

district and school personnel. 

_j f 

Question the staff, the principal, and district 
staff to find ,out yhat the district does to support 
iffie school program and how iielpfjgl that support has 
been in carrying out the prograoP To find out how 
effective such actions wet% 9 tise information 
gathered during classroom observations and from con- 
versations with school and district staff. 
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CRITERIA FOR JUDGING QUALITY 
THE EFFECT OF DISTRICT SUPPWT 



This criterion /ocuses on how effectively the district is supporting 
the sctool .in its efforts to Improve the planned program for the 
students. 



Apply this criterion to Judge t,he quali%|(/of the program in terms of 
the effect of district support for the scwol program. Consider those 
district services provided through regular district funds as well as 
those provided by special fending. 



District policies and procedures to guide 
and support the schools either have not been 
defined by # the district or are unknown to this 
school. The district strategies to assist 
the school are vague or stated in very general 
terms arid en c cm pe ss few of the resources 
available to the district. The strategies 
weds not planned^ Jointly by the school and 
district . and, * therefore v show little 
relationship to the specific objectives, 
needs, and priorities of the school. Efforts 
to guide and support the school have had 
little impact on the school's efforts to 
improve its program. 



■I 



District leadership and support to the school, 
as defiped through policies, procedures, and 
assistance strategies, are known to council/ 
camtittee members and to sane other staff and 
parents at the school. Tt»e district's assis- 
tance -to the* school coordinates and uses many 
of the district, community, and SESR resources 
available to the district and assistance in 
curriculum improvement and staff development 
is generally conjsistent with the school's 
objectives^ needs, ,and priorities. The dis? 
trict's implementation of these policies, 
assistance strategies, has helped the school 
make progress toward improving its program for 
students. 



District leadership and support to the school, 
as defined through policies, procedures, and 
assistwe strategies, is well known to the 
couKil/comdttee staff and parents at the 
school. Jointly planned by the council/ 
canmjjtt^e, school staff* and district staff, 
district assistance, including* assistance in 
curriculum improvement and staff development, 
is based 'on the schools' needs, objectives, 
and priorities and effectively coordinates and 
uses available 'district, community, SESR, 
state, and federal resources. ' The 'district's 
timely and effective implementation of its, 
policies, procedures, and assistance has 
contributed significantly to the. school's 
capability to respond to students' needs and 
interests and has resulted in a high degree of 
commitment to and expectations for success in 
irmproving the program for the students. 
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Area of Investigation 

Communication 'among 
district and school 



) 



District support 
strategies and 
activities 



Primary source of Information; 
Interviews 

«How wel 1-known are the communication channels 
between the district and the school? 

How .well understood by the staff'' Is the dlrecr 
tlon established by the district foe school 
Improvement , bilingual education , compensatory 
education, and. so forth? ^ ' 

How well understood by the staff Is the direc- 
tion established by the SESR for special 
education and related instructional services? 

What kinds of support do the. staff and. 
principal receive In carrying out established 
district directions and policies? 

Are effort* to imprOve^Vhe program for Title 1/ 
SCE, LEP, special education, and gifted stu- 
dents, seen as separate from the regular school 
program? v - 

What ldnd of tnpuf does the school have in the 
design of district strategies and activities? 

What district activities oft support strategies 
are being implemented? What future activities 
or support strateftes^are being planned by the 
district? . • / \ 



Verifying sources of information; 
observation/ documents 

* * 

Observation: Look for evidence of 
district support in the classroom. 
Does the school receive district 
help, in curriculum "development? 
Health and guidance? Evaluation? 
Planning? ILP, flft development and 
implementation? Staff development? 

Documents : , District master plan, 
proficiency^ standards, and 
policies florid* procedures; staff 
development' record^, council 
minutes, the school plan, ' 



> 



* "Use of resources 



In what ways does the district support the 
school in, planning, taplementlng, and evalu- 

ram 



atlng the school program? 

How appropriate . are support strategies to the. 
needs, priorities, and objectives of the school 
program? 

What kinds of . resources are beln|k used to 
support the Improvement process at the school? 

How are these resources coordinated? 

TT-81 
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(PPGRTUNITIES FO^ MOVING OETRICT SLPPCRT 



The st at ©tents listed below Indicate actions f which my have been or 
need to be t^en to improve ^he effectiveness of your- -program. The 
specific opportunities • selected by - the reviewers reflect their 
understanding of your program and their best suggestions for *at your 
next steps might W to mike your program mor^ effective for students, 



a* 



b. 



c. 



Determine what policies, procedures! and strategies a^e needed to 
guide and support program improvement "efforts*. , Modify existing 
exjject at ions /directives /strategics accordingly.^ * , 

v. 

Identify current channels of communication wSich convey information 
accurately and reli*>ly among administrators, governing board\ 
and the school. , 

• Arrfcoos for staff development to ensure full understanding of 
import** issues and concepts cowm/ticated from the 4 district level 
to the school, especially those related to *>plic*>le^laws and 

' ^amaK^^ «n11r\A>{An nrmromsr at the school, a 



staff, and others at the school. The SSC/SAC/BAC, along with other 
staff and parents > shcwld review these suggestions, determine their 
potential effectiveness Jrpr program improvement, and then decide how 
your ongoing planning, translating, and •evaluation procedures will be 
used to incprfwrate ttjeny into your program. 

Selected Opportunities for Improving 9 

< 



regulations", consolidated application, progr 
policies and procedures contained In the 

Arrange for curriculum and/or sttff devfeld 
needed for implement^ the planned prog 



f. 



Assess the effectiveness of current, disf 
and identify resources never' befbr* ujilia 

Request district /5ES« support >4fervices^ appropriate to the schoo*l 
program. 




at the school, and 
master plan.** 

assistance as 



:ces to the school 



g> work with the, district office as you determine your objectives, . 
;nej§ds, and priorities for the coning year, and Jgintly plan what * 
$m when resources ar^needed to meet these objectives and meeds. 

E/S * \\ ^ / ' 
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D. THE EFFECT OF THE IMPROVEMENT PROCESS 

* This election includes two areas of review: the 
effect of. the # Sch6ol Site \ Council/School Advisory 
Council/Bilingual Advisory Committee (SSC/SAC/BAC)* and 
the effect' of planning, translating the*- plan . into 
action t and evaluation. These two areas Include the 
methods or procedures used to improve or maintain the 
quality of education provided for students*. Together,/ 
they constitute the improvement process. in reviewing 1 
the work of the SSC/SAC/BAC and in finding 'out about 
fanning, translating, and evaluating activities, the 
^reviewer learns why instruction and instructional 
support are the way they are and what might be changed 
In the Improvement process to Increase ^and/or maintain 
the effectiveness ' of instructional and support 
•activities. 

The information, collected investigating "The Effect 
of Instruction on Students" and "The Effect of Support 
on Instruction** becomes the base for Investigation into 
this section, M The Effect of the ^Improvement Process." 
The effects of the Improvement process should be 
observable in the planned program, in' the classrooms, 
in the waybill whidh people work together, and in the 
program modifications ' identified by the school 
community. r 



Reviewing the quality of planning and evaluation 
actually .begins with a review of the school plan. 
However, the process of planning and evaluation Is not 
static — it is evolving, changing, and dynamics The 
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reviewer can see the effects of' the planning md 
evaluation procedures that extend well beyond the 
written plan . , The reviewer can develop an under- 
standing of previous use of the procedures*, through 
interviews and .can assess the effects of_ the ongoing 
procedures through observation, interviews, and 
documentation • 

Between planning the program and doing what has 
been planned ^are the crucial activities which translate 
-4<feas Into action. These activities Include communi- 
cation, collaboration, and mutual support among staff 
and others at the school; definition of roles and 
responsibilities; appropriate personnel assignments; 
reallocation of time; scheduling; coordination and 
sequencing of activities; space allotment, ordering of 
needed supplies; .and program monitoring. 

. Throughout this 4 section , It is Important for the 
reviewer to recognize the type of planning and trans- 
lating and evaluation procedures that have evolved at 
the schoi>l. The procedures may be very formal, quite 
Informal, or have elements- of both. They may Involve 
all personnel to the same degree, some personnel in a 
concentrated way, or only a few people. Whatever the 
types of procedures, the reviewer's task is to find out 
how well they have worked to produce a program that 
meets tfve needs of the students, staff, and parents. 
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THE EFFECT OF THE IMPROVEMENT PROCESS: SCHOOL SITE COUNCIL/ SCHOOL ADVISORY COUNCIL/ BILINGUAL ADVISORY COMIITTEE * 



This criterion focuses on how effective the 
SSC/SAC/BAC, have been In carrying out their responsi- 
bilities within the improvement process at the school* 

lit judging the effectiveness of the council/ 
committee in planning f monitoring, and modifying the 
school program, the reviewer ' will use inf ormation 



derived through observing the effects of the planning 
process on support activities and on Instruction; from 
interviews- with staff, parents, mnd council /committee 
members; and from documents, such as membership rosters, 
minutes, and agendas. Evidence collected will Include 
not only the work of the c\>uncl»l/commlttee» but also 
what others in the school community know* and how they 
feel about the wprk of the council/committee. 
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CRITERIA FOR JJ0G1N6 QUALITY 
TWE EFFECT CF THE SCHOOL SITE COJNCIL /SCHOOL AOVISCRY COUNCIL /BILIGOAL ADVISORY CCN4ITTTEE 



This criterion focusesVf how effect ive the SSC^C/B^have been in 
carrying out their functions of planning, monitoring, and modifying cne 
school program, r , , * . 



Apply this criterion to judge the quality, of the .SSC/SAC/BAC in t*nns 
of their effect on the improvement process at the school as weil as me 
school program. \ f 



►teeting* of the SSC/SAC/BAC have been infre- 
quent »xJ/or poorly attended; consideration o^ 
school ccnmunity groups' points of view when 
assessing needs, establishing priorities, and 
determining directions for the program has 
been* limited. The work of the SSC/SAC/BAC 
generally is not taiown; the mentors do net see 
their work as important to the school program; 
little is being done to encourage ether 
parent* and staff to participate in the work 
ot^the council/committee. In developing the 
school plan, only a few* key staff members on 

• the council/cormittee were involved. Corniu- 
nication among the various councils/committees 

6 is limited; each plans separately. Council 
matters demonstrate little knowledge of, or 
corniitment to, the planned program and are 
generally not aware of the^ steps being taken 
to translate the planned program ,into action. 



E/S 



2-00 



In regular meetings* usually well attended by 
SSC/SAC/BAC ♦members, points^ of view from 
several groups in the school ccrffounity are 
considered when assessingTneeds, establishing 
priorities, and determining directions for the 
progran. The work of the SSC/SAC/BAC is 
generally known; the members and sk^ne' ether 
staff and pa?ents see the council/committee's 
work as important. Other staf* and parents 
are encouraged to participate in the work of 
the council/cormittee; e.g., planning and 
monitoring the program. The council/committee 
serves as a forum for discussing tfe develop- 
ment of the school plan, includiog4ne budget, 
and has been somewhat active' in reviewing 
implementation of 'the program and determining 
needed modif iqations.* Each council/connittee 
is generally informed about the major deliber- 
ations or recommendations of the ethers. 
Council members' and some other staf(^and 
parents are 'informed *>out' and demonstrate 
ccmnitment to the planned program. Awareness 
of steps being taken to translate the planned 
program into action varies from high to very 
" limited. 



In regular, wel 1-attend^J meetings of SSC/5AC/ 
B^C points 'of view from all groups in the 
school cormunity have befen actively considered 
when assessing needs', establishing priorities, 
and determining directions for the progrfrf. ' 
The cdfccil/committee has been successful in 
involving other staff, parents, and c&wnunity 
matters in its wotk. The leadership of trje^ 
council/committee during the development of 
the school' plan, including the budget, and 
during continuing review and 'modif icatiorj of 
the program has resulted in increased commit- 
ment to the successful implementation of the 
planned program by other staff and parents it 
the school. . Carman icat ion and cooperation 
^nong the different councils/committee has 
contributed to a wel 1 -integrated progrfm *r 
students., Council mewtoers and others (tomon- 
s trate a h i^ lev el of row lege of and 
commitment to the planned pr%ram, and they 
are well aware of the steps being taMen ip 
translate it into action. 

201 




LOW 



I I 



I I 



I I 



I . I 



11-85 



I I 



II 



V 



II. 



GUIDE FOR COLLECTING INFORMATION ABOUT THE SCHOOL ^OUNCILS/COMMITTEE 



Areas of Investigation 

1 f 



Selection of members 



Preparation of members 



Functioning of the council/ 
committee 



Primary .source of information : 
Interview? 



How were the- members • selected? 
vacancies filled? 



How 



are 



How representative of the parents in the 
connunlty are the parent members? Did the 
selection process provide an yopportunity for all 
interested parents and staffir to become members? 
How representative of the staff are the staff 
members? 

What in-service training did members receive 
about the purpose of the council/committees and 
what their responsibilities are? J 

Hoy well do the members understand the purpose 
a^ the requirements of ' special funding 
sources received -by the school? 

What other in-service training did they receive? 
Who presented it, and how was it presented? 

How were decisions m^de regarding the kinds of 
in-service* training ^presented? 

How often are meetings held? How well-attended 
are they? How representative of the school 
population are those who regularly attend the 
:ings? ♦ 



Verifying sources of information : 
observation/documents 

Observation and exploration with 
schcfol staff and parents: Does the 
council or, committee seem to be 
representative of its constituent 
connunlty? Does the SSC Include 
parents . of students J m receiving 
special services, (gifted and 
talented", LEP, Title s I/SCE 
students, and . students with 

exceptional needs)? 

Document : Selection procedures, 
council/committee agendas/minutes/ 
by-laws attendance sheets, communi- 
cations between schoSp and home, 
school community descriptions, and 
announcements of elections/ 
selections 



What kinds of support services are provided .to 
the council (e'Tg^ translation services 4or LEP 
parents, scheduling and notice of meeting times, 
provision of baby-sitting service, and 
communications about the meetings}? 
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Areas cpf investigation 
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- Primary source of InfbrmaftlQn : 
'. InterVleWs , 

How are. meetings c6nduct*d?Who sets the agendas? 
Do the ageodas reflect the concerns and inter- 
ests of the school- community? Do the by-laws 
and operational prQceduces facilitate the /con- 
duct of the business of the council/committee? 

How c}o counrells/pommilttee keep members of 
the schoo^ community (parents and staff) 
Intoned about (he schopl program? , * . 

Row do parents and staff members -inform* the 
councils/committee of their qoncerrta. or desires 
for the School program? ' 

HoW are the' metobers kept informed about what it 
happening in, the school program^, and how well 4 It 
is working? • * ' ^ 

How^fcre the members Involved in developing the 
plan, In determining desired student outcome*, 
in assessli« needs and setting objectives; in 
developing basic approaches or strategies, and 
in designing evaluation procedures? 1 

How. are members involved in ongoing planning, in 
monitor |bg . tlie program, and in miking, decisions 
about what should be modified and how? How do 
the members Involve others * in the planning* 
process? ^ 

How do the different councils/committee work 
together In designing, implementing, and moni- 
tor! the planned program? 

In what ways has the district supported the 
council/committees? 

How effect ive do councl 1/commi t tee members 
believe they hav* beef in fulfilling their 
responsibilities? • , 

How effective do the parents and stiff members 
believe the council/committee have Keen? 
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Verifying sources of Information ; 
" observatidn/documente - 
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OPPORTUNITIES, FCR IMPROVING THE SOCOL SITE COUNCIL/ 
SdCOL ADVISORY COUNCIL /BILINGUAL ADVISORY Cu>WITTEE 



The .statements list ad below Indicate actions *ich may have *teen or 
need to be t*en to Improve the- effectiveness of your program. The . 
specific opportunities selected by the reviewers reflect their / 

•stions' for what your ' 



understanding of your program and their best suggest Ions' for what youy 
neyt steps mi^tt be to make your program more effective for students, 



staff, and others at the school. The SSC/SAC/BAC, along with dther 
staff and parents, should review these suggestions, determine their 
potential effectiveness for program improvement, and then decide how 
your ongoing planning, translating, and evaluation procedures will be 
used to- Incorporate them Into your program. 



\ 



a. Provide in-service training so that each member understands: 

\ • The purpose of the SS(ySAC/BAC and hts or her responsibilities 
as a mentoer. 

* • 

- Mow to carry out his or her responsibilities for planning the 
. proaram. 

- HoJ fco work with other councils/carmittees, 

- The purpose and requirements of each of the special funding 
sources received by the school throu<J> the consolidated 
application 

b. Verify that individual' SSC/SAC/BAC. mentors are thoroughly familiar 
with the school 4)lan, including services for students witrt special * 
needs, the budget, and the planned day-to-day operation of the * 
progwm. • 

c. Establish or extend communication and collaboration among the 
* various ©ouflbJls/ccmnittee (including the 'Comnity Advisory 

Council). ' 

jf 

d. Involve parents and staff mentoers who are not merrtoers of thp 
council(s) in the work of the group(sK 

t. Involve each member in determining hp* the SSC/5AC/BAC functions. 

f. Ensure that agendas and activities reflect the concerns *of the 
school' canmunlty 

g. Provide services to support attendance of merrtoers and guests such 



Selected Opportunities for Improving 




- Scheduling of meeting times to accamocfate the personal 
schedules of parents and staff 

- - Trwlation^sJfrvices for limited- or n<x*€nglish speaking 
. parents. 



h. Solicit CAC advice on issues related to special education. 



E/S 
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THE EFFECT OF THE IMPROVEMENT PROCESS; PLANNING,* TRANSLATING THE PUHNED PROGRAM INTO ACTION AND EVALUATION 



This criterion focuses 'on Row effective the 
planning, translating, and evaluation ^procedures used 
by the staff arid».p%rents at the, School have been In 
developing and maintaining' a program responsive to the' 
student and program needs. 

In judging the effects of planning, translating 
the plan Into action, and evaluation, use evidence 
collected while reviewing the plan, the instructional 
program, and support services. \ In gathering 
Information about planning, and evaluation, consider the 
jchool plan, the process of planning and evaluation 
that led to the development of the plan, and the 
ongoing planning and evaluation activities. < 

The structure of the school's ongoing planning and 
evaluation process Is not as critical as the 
effectiveness df the process, Its Impact on the 
learning of students, and the Involvement of personnel 
at the school site. 

^The process may be formal, Informal^, or both. It 
may^nnvolve component committees, .total staff, or 
representative .groups of the councils as the forum for 
decision making. Whatever the form, the process* should 
Include the following in order to attain maximum 
effect: . 
. ^ . ' ~ J 

Understanding by all personnel of the consoli- 
dated 'program purposes and requirements 

• Agreement on goals and expectations 

• Agreement on (he program designed to' reach goals 
and expectations , - 



• Understanding* of roles and responsibilities 



• Allocation of resources need to translate the * ' 
plan Into action 

• An .ongoing planning process <N 
. • An evaluation design 

• Use of evaluation information for -modification 
v and. refinement of the program 

/— - 

Once a plan Is writ£en,^ the cycle of translating 
the plan Into action, ongoing planning qnd evaluation 
begins, moving to fepianrfing," to modification, and 
again to translating the 4 modification into action. It 
is a continuous, ~ year-roiind* process involving All 
personnel concerned wifh the Instruction of students. 

. * k ' * • * 

Translation activities $hould Involve everyone 
Included in the planned program. Talk to' staff members 
about how thejT communicate with each other; hflrtf^they 
work together; the kinds of support they receive from 
eacj) other, the administrators at the school, the 
district office; how they know what they > re to in 
carrying out their part of the 'plan-hed program; and so 
forth". Talk to the principal and other administrators 
about how assignments are made, roles are defined, 
translation -V activities are * Supported,* the 
implementation of the planned program la monitored, 
decisions are nde, and problems are' solved, and so 
fSrth. 

The reviewer moves back and 'forth between the 
planned* program and the^ Implemented program- In order to 
understand Interrelationships between planning and 
translating the plan Into action; that Is, what people 
have done, are doing," and will do the make the plan 
become a reality. m 
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CRITERIA FOR JUDGING QUALITY 
THE O^FECT OF PLACING, TRANSLATING THE PLAN INTO ACTION, AK) EVAL6ATION 



This criterion focuses on how effective the planning, translating and 
evaluation prockkres used by the staff and parents at the school ha« 
% been in developing and maintaining a program responsive to student are 
program needs. * 



Apply this criterion to lujJge the quality of the improvement process Iik 
terms of the effect of planning, translating, and Evaluation activities 
on. the planned program. ' ' 



The planning, translating, and evaluation 
procedures used by each council or cormittee 
*Td other staff and parents at .the school are 
i/Klear or little is loowp about then*. There 
is little agre ement on gpals and expectations 
for students or on ihft the school- prolan 
should Kcomplish ant} how. Few ^f those 
lnvofved in carrying out the plan can describe 
how their roles and responsibilities fit into 
the planned program, nor do the daily 
activities of most of the staff and parents 
relate to carrying out the planned program.- 
There is lack of communication, coordination' 
and commitment to improving the school progran 
as planned. Procedures for ongoing planning 
and evaliat ion have not been defined and there 
is little anticipation among parents and sta^f , 
members of developing such - procedires this 
year. 



V 
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The planning, translate and evaluation 
procedures used by the cotucil/cormittee mem- 
bers have led to general agreement among the 
couTcil/cormittee merters *ravX stutfent and 
program needs and about rfiat should be accom- 
plished and how; other staff and parens 
involved in the program generally understand 
*>at those agreements are and are supportive 
of them. Most of the day-to-day activities of 
people at the school are in response to tbe 
planned program. While people involved in 
individual areas of the planned program know 
the goals and expectations f.or students within 
their areas, and *>at their individual respon- 
sibilities are, only seme of the people at the 
school are wel'l informed about the whole range 
of goals\ expectations and responsibilities in 
the plan and how rfiat they do fits in with 
rfiat others do. Procedures for ongoing plan- 
ning and evaluation are defined but infre- 
quently used. Modification to planned activi- 
ties sometimes occur primarily in response to 

f staff's operational problems rather than 
response to observed" effects of the 
instructional program on students. 



The planning, translating, and evaluation, pfV 
cedures used by the coi/Kil/comdttee and ^ 
other staff and parents have led to a high 
level bf agreement 4>oUt student and program 
needs, about rtat should be accomplished and 
^how. Staff and parehts are working together, to 
implement the programmes plapned and the day- 
to-day activities of the people at the school 
are those envisioned in the planned program. 
Everyone involved in carrying the program 
i/Kterstands the overall* intent of the program 
imprevanent efforts, «*at their individual 
roles vtd responsibilities are, what must be 
done to ca£ry out those responsibilities and 
how their responsibilities relate to rtat 
Others are doing or will do. (bpd cowKTici- ■ 
tion, coordination and mutual support are 
obvious. Ongoing planning and evaluation pro- 
cedures are. known to all involved in trie pro- 
gran and routinely used. Modifications -of 
planned activities are made in response to the 
observed effects of planned instructional 
activities on student! and observed effects of 
support activities d* the instructional 
program. \. » "211 
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GUIDE FO* COLLECTING INFORMATION ABOUT PLANNING, , TRANSLATING THE PLAN INTO ACTION 

of Investigation , ■ K 

How have staff and parents been ' iovolved 
planning? Who was Involved? f f 



Primary source of Information !: 
Interviews * ' 



Verifying sources of Information: 
observation/documents 



Agreement about the 
* planned program 



In 



r 



How did the planners Inform others about the 
planned program? How d Id *t hey * ge t at he r s 9 
Input In planning? How was thl$ .Input used? 

How were agreement! about thfe planned program 
reached? How widespread are/ the agreements? 

What process is used when' there is a lack of 
agreement? \ Ar^lnformal as well as formal dis- 
cussions of problems or solutions encpuraged? 

How well do personnel responsible for planning 
and implementing the planned program understand 
.the purposes and requirements • of the Consoli- 
dated Appllcatlon/jESR programs *r the school? 

y , 

What in-aejgvi'ce training for planning and eval- 
uation was provided the staff and the council/ 
committee? V 



Observation s Is, there an atmosphere 
of communication and collaboration , 
the jchool? > H>o{ 
to understand and 
to the planned 



among staff at 
personnel appear 
have commitment 
program? ' 



Documents : Co unci 1 / cnmmf t tee 

agendas and minutes; a,taff meeting 
rf cords; interataff communications; 
district Communications; SESR 
records - and communication {ftoae/ 
school comnunclat ion. 



Understanding roles and 
responsibilities 
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How are responsibilities for the various parts 
of the planned program determined? 

* • / 

How well oo people understand their own roles 
and responsibilities? Do they understand the 
p>les and responsibilities of -others? 

How well do they undersfarffe how their activi- 
ties and responsibilities relate to what others 

do? , m ' ' - 

t * 

How haye staff been prepared to learn, under* 
stand, and accept the roles and responsibili- 
ties of their jobs? 
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Observation i Are the roles defined 
Tn the plan being carried out by 
the personnel aslgned? Do' people 
know what they are supposed 'to do? 
With wtiom? 

Documents : Any records of planning, 
translating, and evaluation activi- 
ties including ptmos, .and other 
communications emong staff and 
councils; ifePs^ILPs; the school 
plan, standarlted end. other test 
data; survey date; Inters taff 
communications* 
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Area of Investigation 



frrlmary source of Information: Verifying source* of Information: 

interviews observation/documents 



Ongoing planning and What ongoing planning procedures (formal and/or 
^evaluation procedures' Informal) are used to make program raodifica- 

* tlons? Who Is responsible for what? Does the 
process, work? Is there commitment to the 
" <• • process? ^ * 



t 



What is the ongoing planning process by which 

the local school personnel contribute, to the*~ „ 
.revision/modification of the SESR plan? 
) , * * * 

\ What types of evaluation Information are * 
gathered? How frequently? Who is involved? 

r 

How are evaluation data used in planning for 

program change? » ^ 

How do staff and others know whether or not 
what they have planned and implemented is 
making a difference in student learning? , . ' 

What personnel are involved in planning and 
evaluation activities conducted schoolwide? 

What are the\ procedures for identifying and - 
i " solving a problem yln translating the plan into 

/ > action? Who is jinvolved? 

: A > • t 

How does the problem solving process relate to 

the dngoing planning and evaluation process at 
the school? , 

• v . - y * 
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CPPQRTtNITIES FOR IMPROVING FJrfWING, TRANSLATING THE FLAN IN>0 ACTION,) AND EVALUATION 



flNG THE^P 



The statements listed fcelow indicate actions i*ic& may have been or 
need to be taken to improve the effectiveness of your program. The 
specific opportunities select ed ♦ tJy the reviewers * reflect «ttSeir 
understanding of your program and their best suggestions for that your 
next steps might be to make your program more ef^&ctive for students, 



, a* Allocate time and resources for planning, translating, evaluation 
activities. 

b. Identify individuals to provide specific leadership in planning and 
for ongoing planning and evaluation. 

♦ « «. 

.c. Clarifv who is responsible " for what, and - tow the various Toles* 
are related to efech other. 

d. Establish effective comnhicat ion and coordination procedures. 

e. Provide staff development so that each adult working in the program, 
inducting those providing services for students wit^ special needs, 

* understands: 

- The intended impact of the planned program on staff and students 

- His or her own individual role and responsibility in carrying 
out the specific activities of the plan and, how and with whom to 
work in carrying out the specific activities of the planned 

4 program 

- How newly planned activities fit with existing program activities 

f • Est^>lish a process for monitoring the implementation of the planned 
program, including services for students with special needs. 

*g. Establish a decision-making process for making program modifications 
whichj>rovides for: 

- Using evaluation results to confirm^ previous agreements or 
detesnining the need for change *, 

- Developing alternative procedures and selecting among those 

. alternatives > 

- Implementing selected procedures 

h. Ensure tbit the SSC/SAC/BAC are, central tp the decision-making 
process. 

> 

E/S 



staff, and others at the school. The SSC/SAC/BAC, along with other 
staff and parents, should review these * suggestions, determine their 
potential effectiveness for psAram improvement, end then deeide how 
your ongoing planning, translating, and evaluation procedures will be 
used to incorporate them into your program. 



Selected Opportunities for Improving 
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OGRAM REVIEW FINDINGS 

-f 



What the Final Report Includes 




This chapter Includes a description of how the 
findings* are shared with the school community through 
the final report. While parts of this, chapter will be* 
useful t# schools conducting Internal or self-reviews, 
the chapter Is Intended primarily for State Department 
of Education or Consortia* reviewers. 

The final report Is both a written and an oral 
report delivered at the conclusion of a program tevlew. . 
It is the means through which the findings of the review 
team, together with the reviewers' suggestions frfr how 
the Jchool program might * be Improved , ..are Shared with 
the staff, school councils, • district represen- 
tatives, and other patents' and community members at the 
school. It Is the mpst critical element of the entire 
review process. 

$ The purpose, of the final report Is to provide' for 
those at the school a reflection of the current 
effectiveness of the school program, and clear 
suggestions for ways in which the effectiveness of the 
program. can be sustained and/or Increased. K successful 
final report not only confirms and nfc tends the knowledge 
that staff; and parents have about thetir program, but 
also yields * suggestions about bow the Improvement 
process at the school (i.e. ongoing planning and 
evaluation activities and activities used tu translate 
the planned program Into action) can be used to make the 
program as effective as it was Intended to be. A 
'successful final report is a stimulus for -continuing 
program Improvement. « 



Two forms are used for the final report: the quality 
criteria and opportunities for improving -are Included* In 
Chapter II of this handbook; the compliance criteria "are I 
published separately. 

Both report forms are organized accusing to the 
model of a school program described earlie^(see Chapter 
I). The forms Include a section for each concentric ring 
'within the model of a school program: 

• Instruction 

• Instructional Support 
e^The Improvement Process . 



Within each of the sections, the quality report form 
dsp organized into two types of review findings: (1) 
quality or effectiveness; and* (2) opportunities for 
improvement. These two types of findings represent the 
two distinct perspectives from which the school program 
is viewed. The quality criteria are Intended to describe 
the effect of activities on the client (e.g., the effect 
of instructional activities on students or the effetJP'of 
support activitie/ on Instruction).* The opportunities 
for improving dea^jpibe what the school staff and others 
are doing or might do to ach^pve beneficial effect's on 
students. The Intent of the quality rating 1% to give 
the school a status report on the effectiveness of the 
current program. The intent .of the 'Opportunities for 
improving is to suggest activities on which the school 
might next focus Inf its formal and Informal ongoing 
planning and evaluation process and In translating the 
planned program into action. 
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Hov the Pinal Report Is Developed 

r 

Preparation for the final report Is concurrent with 
the process of program review, for the report Is based 
oh all the Information the ; team has gathered through the 
Investigatory methods of observation, Interview, and 
document review. Information Is tested, verified,, 
analyzed, synthesized, and reported via the quality 
criteria and the opportunities for Improving of the t 
quality report form. 

1 Using the process described In Chapter 11 of this 
handbook, reviewers gather Information during each day 
of review, and during each day confer together to share 
what has been learned, to test the validity of what has 
been observed, to plan ways to verify information that 
is not yet certain, to plan how to gather needed 
information, and to identify possible' opportunities for 
improving , the program. During i these Conferences 
reviewers measure the information they have gathered 
against that ' required to make a judgment about the 
quality of the program and opportunities for improving 
each program area being reviewed. j 

* 

During these conferences, reviewers will: 

o Identify areas that requi*^ pore information, and plan 
strategies to collect it the next day (e.g., who will 
return to a particular classroom to gather additional 
information or who will ask a particular person 
certain questions). 



• Develop tentative judgments about program quality, and 
identify possible opportunities for Improvement. 
Identify additional evidence needed to verify these 

.judgments* 

— - * 

• Identify and agree on each reviewer's responsibilities 
for^the next day. 

Prior to the final report on the last day of the review, 
the reviewers will: j 

a Review the school plan and all information gathered 
during the visit 

• Compare information collected and reach agreement on 

judgments for each quality criterion 
*> * 

f Identify for each area of the review the most promising 
next steps for the school to take 

* 

• Prepare to explain why eachi criterion 'was so judged and 
why the identified opportunities were selected 



• Write the opportunities for improvemeht in terms of tft« 
school's owp Improvement process, stating each 
opportunity so that It can stand on Its own and be. 
understandable to a reader who was not. present at the 
final report 

• Decide on the orde/ of the presentation ancf tfee 
responsibility each reviewer will take in presenting 
the review findings 
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How the Review Findings Are Presented f 

1 ; — r 

/ Although the review findings are presented as the 
• final event of the review, preparations for that final, 
event begin during the first .review day when the 
revlAw^rs discuss with the principal: 

e Whe\the report Is to be given and when; how many 
people are expected; and how, the room is^bo" be 
arranged 

• How copies of the quality criteria can H nade 
available for those In attendance 

• What special equipment irfight be needed (e.g., overhead 
projector, chalkboard) . ^ ^ * 

The report itself is presented in two sessions on 
the afternoon of the lastr>day of the review — first to 
the school principal and whomever he or she selects to 
be present at the preliminary report and then to the 
school community at the final report. 

v 

The purpose Of the meeting. with the principal is to 
share findings and to clarify any quest 16ns or concerns 
the principal may have about those findings. It is 
' important to note here that if discussion has been 
^ ongoing between, reviewers and the principal and others 
at the school, the findings will come as no surprise. 
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In presenting * the final report to the assembled 
school community, reviewers begin the report by; 

• Recognizing that a<Sme people in the audience may not 
have participated in the review and that many have 
participated in only one part of the review, restating 
who -the review team members are, why they $re there, 
and the purpose of* the review 4 

• Emphasizing that theyreMew is of tbe whole planned' 
program, not of individual classrooms or particular 
parts of the totJI program atod that compliance with 
laws an^T regulations is part of the review 

• Explaining how the quality criteria and 'opportunities 
ate used and how they relate* to eaclj other 

f 

• Recognizing the effort expended by staff and others in 
implementing the planned program arid/or their efforts 
at improving their program 

In presenting the* findings to the school community, 
the reviewers willr 

• If there are no compliance exceptions, report so at 
the beginning of the session ^ . 

• Present the compliance findings 

- if there are compliance exceptions, briefly 
v discuss each exception, stating what about the 

program is out' compliance and what should be done 
to bring it into compliance.. 
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• Describe the„ reviewers' findings for eaqh area of * v 
review. This oral description must >e related to the 
descriptive paragraphs of the criterion; it nay be 
illustrated by a transparency for overhead projection 
or'by reading or paraphrasing from the criterion the 
sentences of the descriptive paragraphs that are 

appropriate for that particular school 

* • f 

t * • 

e <Present the quality rating ' x 

% Identify opportunities for improving the program. 
Expand on the written statements by sharing ideas or 
recommendations on how the school staff and parents 
can use the planning/evaluation process to Improve the 

v 'program 

NOTE: Findings are not • negotiable. If the school 
'personnel believe that V he finding on a specific item 
does .not accurately reflect the progz^m, they may give 
additional Information on that ft em after the report is 
completed. The, reviewers may find 1 It n^essary to 
request documentation or other validation of that 
information followii* the completion of the teport., , 

* ** , ^ 

• Repeat this procedure for each program quality 
criterion * 

e Open the report to questions and matters requiring 
clarification 

* 

The reviewers will ^ecide in private whether the 
additional information is new to them or whether it has 
already been considered. If it is new information, tfrey 
may. use it to review the accuracy or completeness ef^the 
judgment In question. * 
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The report Is concluded by the reviewers by thanki-^ 
the schpol community for its hospitality and completitfe 
trie review paperwork. 



Follow-Up to a Program Review 

'j 

While the Department of Education has no standard 
procedure for following on the quality findings, 

compliance exceptions are monitored by the Department. A 
school with compliance exceptions has 45 days In which to 
respond with a solution to the problem or, if the problem 
is one which cannyt be resolved within that time frame, , 
to enter into a compliance agreement with the Department,, 

stating how the problem will be resolved and when. 

* 

For follow-up assistance in implementing the recom- 
mendations or suggestions for' program improvement, the 
school personnel should contact 1 their district resources, 
their county office, the State Department of Education, 
private or public institutions, staff development centers 
within their area, or whatever they decide would be best 
for them. , While external agencies should be aware that 
schools which have experienced an analysis of the 
effectiveness of their program — whether internal' ot 
external—are most receptive to program improvement 
suggestions, the decisions about who shouM help in 
implement! recommendations or modifying the planned 
program rest! with the tfchool and district. 
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